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INTRODUCTION 



Statement of the Problem 



The purpose of this project was to develop and 
determine the effectiveness of a reading kit for use in 
developing the reading ability of adults whose reading 
level is below the seventh grade readability level. 



Need for the Study 

Although there are many reports on literacy edu- 
cation there is little experimental research literature 
on the development and use of literacy materials and the 
present researchers found no research literature on the 
effectiveness of the kit or reading laboratory approach 
for teaching reading to functional illiterates. Kits 
developed for use with children are quite popular with 
the teachers of adult basic education classes. However, 
much of the content of such kits is inappropriate for 
use with adults. 

Brice, et al . . point out the need for research in 
adult basic education materials when they state that, 

"The need for research is urgent and pressing in terms of 
discovering new methods of teaching adults how to read, 
of trying [sic ] to develop the type of course content 
this material should have^' (9). They go on to point out 
the immediate need for newly developed materials when 
they state that, "The need for adults [sic] basic educa- 
tion materials is urgent . . (9). 



Significance of the Problem 

Despite the war on poverty (15) and the thous- 
ands of adult basic education classes in the United 
States, it is only since the fall of 1965 that a very 



There were over 200 classes operating in Florida 
alone in the academic year 1966-1967> according to an 
interim report of the Florida State Department of Educa- 
tion. Interview with Dr. W. G. Bradtmueller, Adult Basic 
Education Section, Florida State Department of Education, 
March 1, 196? o 




few well-designed sets of adult basic education materials 
have been published (8^ 9> 10, 11, 16^21, 23,42) . Further- 
more, ^ the content of much of the published literacy 
materials emphasizes only the most basic skills of read° 
ing, writing, and arithmetic (13)> and much of it appears 
to be more appropriate for children than it is for adults. 

Literacy education has commonly been concerned 
with teaching only basic skills. Much of the teaching 
has been done using elementary school materials with an 
elementary school teacher presiding. This concept is 
reflected in the now seldom used title "elementary edu- 
cation for adults" (9,10). 

The adult functional illiterate needs to acquire 
a command of the basic vcommunication and learning skills, 
as well as much basic information about the society that 
surrounds him (19,27,41). He needs the knowledge and 
skills that are basic to the adult world. Thus he needs 
not an elementary education program but an adult basic 
education program and the materials used to teach read- 
ing in this program should contain information in such 
areas as: occupational orientation, use of leisure tjjne, 

law for the layman, consumer education, family and civic 
responsibilities, and basic science concepts (18,19,28, 

42) . Such essential materials appropriate for adult 
basic education are relatively unavailable, and where 
available are widely scattered (15) . 

One consideration for an optimal adult basic edu- 
cation program is that the content of the curricul\xm 
should be integrated into a whole rather than being taught 
as separate segments (43) and a method of integrating the 
curriculum is to use the general knowledge area content 
while teaching the basic skills of reading, writing, and 
arithmetic. Such an adult oriented content should be cf 
high interest and of immediate usefulness to the adult 
student (3,14). 

Another c.onsideration in material development for 
adult basic educsition is the organizational format of the 
material. Individual differences in learning rates must 
be taken into account for the adult basic education stu- 
dents tend to be failure oriented (6) and they 
tend to drop out of classes that do not meet their needs 
as they see them (7)* Thus an instructional approach 
that allows each student to succeed immediately and that 
allows continual success by permitting the student to pro- 
gress at his own rate is necessary to keep the attendance 
of the student, and his progress, at a maximum (28) o 
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Homogeneous grouping by ability or by academic 
level is one approach to the problem of individual differ- 
ences, However^ it has been shown that such grouping does 
not actually provide truly homogeneous groups (1) and that 
under good teaching the range widens within a few weeks, 

A review of the materials now available to the 
adult basic educator reveals a paucity of reading mater- 
ials designed to systematically teach the facts and con- 
cepts of the general knowledge area of adult basic edu- 
cation. It also indicates that not one of these materi- 
als 9>^so makes adequate provision for individual learning 
rates (9^11) . 

The purpose of this study was to produce and 
test for effectiveness a kit of instructional materials 
designed for use with adults who are reading below the 
seventh grade readability level. The kit was to be at 
the adult interest level with the content coming from 
the general knowledge area of adult basic education. 

The kit was to be designed to take into account individ- 
ual differences in learning ability. The study attempts 
to determine (a) the effectiveness of the kit in teaching 
reading and (b) the appropriateness of the kit for adult 
basic education. 



Review of the Literature 
Historical Perspective 

In the introduction to ¥ard*s bibliography, 
Ambrose Caliver states that, “The first intensive efforts 
to implement organized learning for illiterate adults in 
this country came with the establishment of the famous 
*Moonlight Schools* of Kentucky ...” (12). 

, These first moonlight schools began in September, 
1911 (40). The content of vehicles for teaching the 
literacy skills centered around ”... history . • . 
civics, English, health and sanitation, geography, home 
economics, agriculcure, horticulture, and good roads” 

(40) • But, There were no readers in print for adult 
illiterates, so a little weekly newspaper was published 
as a reading text" (40), The development of this news- 
paper was seen as necessary for the use with adults as 



A review of over 300 materials, critiques, and 
reviews of materials revealed no material meeting these 
criteria. 



3 




m 



basal readers designed for children was even then con- 
sidered inappropriate (40). ¥ith the spread of the lit- 
eracy movement from one small community throughout the 
commonwealth and the establishment of an illiteracy com- 
mission for the commonwealth in 1914 > it was recognized 
that more general instructional materials were needed# 

A series of readers for the adult, the COUNTRY UPE 
BEAiDERS . were published (40) • The style of the readers 
bore a strong resemblence to the McGuffy readers that 
had been so popular for use with children during the 
years 1896 to 190? (39) • The content followed the gen- 
eral curriculum as specified above. 

The literacy movement began to spread to other 
states. However, the materials in use did not spread. 

Berg reports the materials used by one teacher who Joined 
the literacy education movement in South Carolina in 1914 
as . • • the calendar and . . . the basic spelling list 
for farmers . . .” (3). Thus it can be seen that Kentucky 
was indeed making great strieds in leading the production 
of literacy materials# 

The coming of the draft during World War I caused 
a change in the content of the published materials. "New 
text books were written . . . The Soldier »s First Book 
fi-nd Soldier *s Tablet were the names given to . . • [the 
new ] readers and writing books" (40). The content per- 
tained to life in the armed forces, but even these mate- 
rials were used only in one locality and little training 
in literacy skills was available in the nation as a whole. 
Stewart probably overstated the problem when she wrote. 
Nowhere else in America were illiterate registrants be- 
ing taught" (40). 

The necessity for literacy training began to be 
recognized by the federal government, and in 1917 the re- 
quirement of literacy for naturalization was enacted 
(24) . ^ In 1918, The Soldier *s First Book was revised and 
contributed to the Y*M#C.A#, the educational arm of the 
Government [sic] for publication ..." However, the 
armistice of 1918 changed these plans "... and the 
Government sent 50,000 Country Life Readers overseas for 
illiterate soldiers detained on foreign soil" (40). This 
was the first wide-scale distribution of literacy mate- 
rials. Following World War I, the topics of instruction 
in literacy classes began to include sanitation, health, 

f ood roads, thrift, better speech, and better citizenship 
40) • Thus it can be seen that even a half century ago 
some educators recognized the necessity of using adult 
content in teaching adults to read. However, this 
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realization was founded on logic and not experltuental 
evidence, for only one piece of research during this 
period has come to light « It was Stewart *s report of 
historical research she imdertook on the literacy move- 
ments she states that **« « , nothing was to be found 
save a few statistical reports • • • (40) on the ex- 

tent of illiteracy. 



Interest in the native illiterate dropped off 
after World War I and was not revived until the Great 
Depression. One agency used to attack the problem was 
the Civilian Conservation Corps which came Into exist- 
ence in March, 1933 • Some "Purposes of CCC Education 
were • , , 1. Removal of illiteracy, 2. Correction of 
deficiencies in elementary school subjects . , (30). 

Materials used in the CCC camps included "... special 
manuals published by the corps area educational offices 
• • • advertisements, road signs, cartoons in newspapers, 
and camp signs bearing words of common usage . . v30). 

During this period. Bond, as well as Hill aSd 
Cherry, reported on the use of literacy education teach- 

the Works Progress Administra^on 
(5^22)5 but such programs appear to have been scattered 
and ununified. 



World War II again brought the federal government 
face to face with the problem of illiteracy. As the need 
for raanpojfler grew, the illiterate was drafted and taught 
to read (44). The army»s task was without precedent (34) 
It . . . could find no materials suitable for the pur- 
pose • , , (10) so it developed its own materials in- 

cluding filmstrips for the introduction of new words, a 
reader, some supplementary bulletins, a monthly magazine, 
and a weekly newspaper. Most of the content, of course, 
directly pertained to the war (44). 

In their comprehensive survey of the materials 
available for use in adult basic education. Smith et al,. 
review three materials published in the 1940* s. They 
consider only one adequate, in the broadest sense, for 
use in the introductory stage, and they suggest it only 
as a supplementary material. The three materials were 
published in the years 1948 and 1949. The three com- 
prise a total of only 282 pages (37). 

J . Smith in Books for New Readers. A Bibliog - 
raphy reports no materials at the introductory stage 
with a publication date reported in the 1940 *s (38), 
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and No B. Smithy in her comprehensive review of the his- 
tory of reading instruction, mentions the 1950 *s as a 
period when • adults began coming to reading cent- 

ers for . • 0 instruction. These people usually were 
not . . . Illiterate" (39). 

Smith, et al .. review two materials of this 
period that they consider adequate for teaching reading 
in the introductory stage. One set of simplified classics 
appears more adequate for teaching English as a second 
language than for teaching the native born illiterate, 
and the other is a reading kit written for children which, 
today, would not be considered adequate for use with 
adults (37). Of the two materials mentioned as adequate, 
the content of the first was short articles chiefly con- 
cerned with men at war, history, and heroes while the 
contents of the other concerned occupations. These 
materials were published in 195^ and 1959 respectively. 

J. Smith reports one additional material for use in 
teaching reading at the introductory stage published in 
1955 that is suggested as "helpful" (38). 

The lack of materials adequate for adult basic 
education instruction during the years 1900 to 1959 is 
evidenced by N. B. Smithes statement, speaking of lit- 
eracy education, "New materials need to be developed 
. . .” (39). Further evidence is given by the fact that, 
although N. B. Smith* s review of materials for teaching 
reading during this period is excellent, she does not re- 
view a single material Intended for use in adult basic 
education classes (39). 

The Manpower Development Training Act of 1962 
was amended in December 1963 to make provision for adult 
basic education. In the 19o0*s, but prior to this amend- 
ment, two materials were published for use with native 
born adult illiterates in introductory stage classes. 

One was Intended to be used in accompanyment with a tele- 
vision course of instruction, the other was an occupa- 
tionally oriented series. The materials were published 
in 1962 and 1963^ respectively. Smith, et al .. con- 
sidered both of them ^'adequate"; they also considered 
adequate six materials published for children. One 
material for children they considered more than adequate, 
and three are considered inadequate. Also considered in- 
adequate for use with native born adults are two materials 
written for the teaching of the foreign born (37). J. 
Smith reports eight additional books published during 
this period. All are intended as supplementary reading 
(38). 
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With the passage of the December, 1963 amend- 
ment, publishers began to bring out . the newest 

adult literacy materials [ which] reflect the crash pro- 
gram behind them and are so poorly designed and exe- 
cuted as to be almost useless to the teacher who has 
ey^n minimally realistic standards. As of the fall of 
1965^ there is no set of materials, regardless of pub- 
lishers* claims to the contrary, which provides a sound 
basis for an adult program . • (11). 

Smith, et al .. list ten materials of this period 
as inadequate, seven as adequate, and two as more than 
adequate (37). Burnett may have excluded any or all of 
these and other mterials, published before his review, 
as not meeting his criteria for any one or more of the 
following reasons: (1) material is of too little extent 

to raise the user in reading ability at the same rate the 
material progresses, (2) material introduces new words 
extremely rapidly— a fault of most material of the "lin- 
guistic approach, (3) material is of an interest level 
more appropriate for children than for adults, or is of 
low interest level altogether, (4) material does not 
allow enough flexibility to allow each student to work 
at his optimum rate, (5) material is published on paper 
and in a type font inappropriate for the beginning 
reader, (6) readability of the material is not care- 
fully controlled, (7) material needs to be supplemented 
by large amounts of material or is itself intended as a 
supplementary material, (8) the content of the material 
is not appropriate to adult basic education. 

Since the publication of Smith, etal, *s, anno- 
tated bibliography, the Florida State University Funda- 
mental Education Materials Center has reviewed three 
materials intended for use in teaching reading at the 
introductory stage of adult basic education. One of 
these materials is considered an adequate supplementary 
materials one is adequate, but has the faults of a "lin- 
guistically oriented*^ programs and the third is inade- 
quate (17). J. Smith reports one additional "helpful 
book published during this period (38), 

the material intended for the introductory 
stage and for the native born adult illiterate as re- 
viewed by Smith, et al . . J, Smith, and Geeslin only one 



* 

Type font refers to the style of characters 

used. 
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material was designed to account for individual differ- 
ences in tooth learning atoility and reading stage * It is 
founded on the "linguistic" approach and has the fault 
of a too rapid word introduction rate, nor does it stress 
the content previously shown to toe necessary for adult 
toasic education (17^37)* 

It can toe seen that few materials are actually 
availatole, as compared to the materials availatole for 
use with children, "If adults requiring adult toasic 
education training are to toe truly served, instx^ictional 
systems must toe made availatole which go far toeyond the 
materials of limited usefulness which now exist" (9)* 

Pertinent Research 

If materials suitable for adult toasic education 
are scarce, adequately reliable research on them is rare, 
A review of this research is given toy Barnes who states 
that he includes ", , , the bulk of the research con- 
ducted and reported in this field" (2) , He reviews only 
four studies on instructional materials published prior 
to the 1965 date of publication of his review. His 
critical analysis points out such a lack of controls 
that he enumerates each piece of research as either un- 
reliable or of such a nature as to prevent generaliza- 
tions toeing drawn from the results (2), He concludes. 

The reviews of field testing that have been completed 
and reported point up a need for so\md design strategy 
for future field testing of instructional materials" (2), 

The lack of adequate research, as pointed out toy 
Barnes, may toe exemplified toy a study published just 
three months after his review. An article entitled "The 
Unifon System" reported on a study having no control 
groups and an experimental mortality rate of 75 pea^ cent. 
The conclusion drawn from the study was that the teaching 
of reading in the introductory stage could toe founded up- 
on the proven adequate" Unifon System (26), 

Other reports on systems or programs are mainly 
anecdotal. Two such reports on materials for use in adult 
toasic education are Caliver*s and Neff*s, Caliver de- 
scribes a project intended to develop an adequate mate- 
rial for literacy instruction. The materials were de- 
scribed as prepared and published (12), No field test 
reports on the material have been discovered. 
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Neff reports on Systems for Success, Words in 
Color, Laubach System, Learning Laboratory, Steck System, 
Reading in High Gear, Unifon System, Operation Alphabet, 
and the Read and Write Series# He states that * 

none of . . , [these] systems provided a wholly satis- 
factory program . . . [needed are] materials that focus 
on consumer education, health, social studies, homemak- 
ing, and hiiman relations” (29). No research results nor 
criteria for determining the adequacy of materials was 
reported. 



One isolated experimental research study has 
been discovered. Laubach reports a study which used 
adequate controls^ however, the material used in the 
study was not intended as instructional material and is 
not commercially available (25). 

The fact that Laubach* s study is indeed an iso- 
lated piece of experimental research can be seen in the 
fact that Harris, et al ■ « report no research dealing 
with illiterate adults from July 1, 1964 to June 30, 

1965 (20). Further, of four articles pertaining to 
literacy education reported in The Reading Teacher in 
October, 1965> and one in November, 1965, none reported 
research (32,33). 

The Jou rnal of Reading , a canpanion journal to 
Ahe Read ing Teacher , also carried a report on a literacy 
program. The anacedotal report was by Rosner and Scaty. 
They report no data nor statistics on the population; 
and they used no controls what -so -ever (35) • 

A similar report is made by Pope. Again, no con- 
trols were used. However, it is reported that, "Semi- 
programmed material available in reading laboratories 
was of greatest help ...” (31). 

Thus it can be seen that even the reports carried 
by respected journals are mainly anecdotal. Such reports 
are to be found as the body of the literature on materi- 
als for adult basic education. 

It can be seen that a field tested kit, adequate 
for teaching reading to the native born adult illiterate 
at the introductory stage, will be a step in the direc- 
tion of using research rather than opinion in determin- 
ing the value of adult basic education materials. 






Ob.iectives 



The major objectives of this project were: 

1. To design and prepare the experimental 
edition of a material for teaching reading to function- 
ally illiterate adults. 

a. the material was to be extensive enough to 
raise the reading ability of the user at a rate greater 
than or equal to the rate of increasing difficulty of 
the material itself. 

b. the material was to be of high interest to 
adult students. 

c. the material was to include exercises for 
developing the reading skills of word attack, comprehen- 
sion, and critical reading. 

d. the material was to be organized in a manner 
that would allow provision for individual differences in 
learning rates through individualized instruction. 

e. the readability of the material was to be 
carefully controlled through the use of a readability 
formula . 



f. the content of the material was to be that 
shown to be necessary in adult basic education. 

2. To field test the material to determine: 

a. expert opinion 

b . teacher acceptance 

c. student acceptance 

d. if any significant differences in reading 
gain would be found between classes using the experi- 
mental edition of the material to be prepared and classes 
using traditional materials. 



ORGANIZATION 

The organization of this final report follows the 
recommendations in Instructions for Preparing Substantive 



10 









Reports Based on Research Pro.iects Supported by the 
Office of Education, Bureau of Research , However, this 
report encompasses three completely different topics 
(the experimental material, the gain studies, and the 
rating studies), with several related studies composing 
each of the latter two topics. For this reason; the 
hypotheses, method, results, discussion, and conclu- 
sions will be contained within the presentation of each 
topic or study as well as an overall presentation of re- 
sults, discussion, and conclusions being contained at 
the end of the report and proceeding the summary of the 
entire report. 



PART I 

A DESCRIPTION OP THE EXPERIMENTAL iMATERIAL 



As originally proposed, the experimental material 
was to consist of two core packages containing material 
from readability level one through readability level 3.9, 
and from readability level 4.0 through 6.9, respectively. 
The division was to have been into three grade levels" 
per package. Each level was to have contained one lesson 
in each of five content areas, or a total of five lessons 
per level, fifteen lessons per package, and a total of 
thirty lessons. However, it was soon decided that such 
a material would not be extensive enough to raise a stu- 
dent's ability as rapidly as the material *s difficulty 
increased. The result would have been the production of 
a material that would have required great amovints of sup- 
plementary material and this would have been adequate for 
only minor supplementaxy use. Therefore, it was decided 
to greatly extend the project and the following amount of 
content was arbitrarily decided upon: 

1. Package One was designed to contain five subject 
areas with three lessons per area for level one and six 
lessons per area for levels two and three for a total of 
75 lessons (5) (3 + 6 + 6) =75* Later, two extra lessons 
at level two and an additional lesson on critical thinking 
were added, making a total of 78. 

2. Package Two was designed to contain five subject 
areas, four lessons per area on three levels for a total 
of 60 lessons (5) (4) (3) = 60. Later, two additional 
lessons on level six and an additional lesson on critical 
thinking were added, making a total of 63. 
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3« The total experimental material consisted of 140 
lessons and a teacher <s manual. Since each lesson con- 
tained approximately 600 running words, the entire ma- 
terial was quite extensive. It contained approximately 
84,000 i^inning words. 

The content of the lessons was taken and re- 
written from uncopyrighted sources, principly from docu- 
ments published by Federal and State agencies. Since 
the changes and additions made were great and since some- 
times the intent of the author was changed, no credit 
was given. 

Each lesson was compiled individually into a 
pamphlet. The pamphlets were color-coded in one of six 
colors to designate their grade levels. Finer discrimin- 
ation in readability level was achieved by ordering the 
lessons within each content area and by shoxfling the rank, 
from easiest to hardest, on the cover. The cover also 
bore a design to distinguish the various content areas. 

This organization of the material allowed the 
student to begin at his reading ability level and pro- 
gress upward. For example; one student might begin at 
grade level two. Working within the second level, by 
selecting the appropriate color of cover, he would read 
each of the rank booklets (lessons). There were 
five of these, one in each content area. When he fin- 
ished, he would read those booklets marked with the rank 
2 . In this manner, the student would read five les- 
sons before the difficulty of the material moved up an 
approximate two-tenths of a grade level. This quantity 
of material (approxjbnately 3,000 running words) should 
have enabled all but the slowest students to read enough 
material to progress in ability at a rate at least equal 
to the rate at which the material gained in difficulty. 

Many students would not need nor want to read all 
of the material at any one level before they begin read- 
ing at the next higher level, so the material was design- 
ed to allow individualized instruction which vjould pexmiit 
the teacher to move the students as rapidly as their read- 
ing abilities increased. Wo student has to read all of 
the lessons. Each reads only as much as he needs in order 
to progress. 

The experimental edition was run on a mimeograph 
machine and the print was poor. This factor was noted 
by some of the experimental subjects. 









PART II 

THE GAIN STUDIES 



Study One 

In the early spring (March and April), the ex- 
perimental studies were begun. They were to determine 
if there would be any significant difference between 
the gains made by classes using traditional materials 
as compared to classes using the experimental material. 

Method 



Selection of Population 

With the aid of Dr. Weldon Bradtmueller of the 
Florida State Department of Education, fifteen adult 
basic education classes were obtained for the study. 

The classes had an enrollment of approximately twenty 
students per class. The classes were distributed into 
experimental or control treatment groups according to 
the teachers* stated preference. All classes were lo- 
cated in northern Florida. 

The results of the distribution yielded nine 
classes in the experimental group and six classes in the 
control group. In each locality, there was one control 
group to insure that students of the same region were 
being compared. Three localities had more than two 
classes. For this reason nine experimental classes were 
used while only six control classes were used. In each 
area, at least one teacher had no preference, and was, 
therefore, assigned to the treatment group so that the 
distribution yielded one control class per area. The re- 
maining classes were experimental. 

The procedures used shou3.d have yielded a total 
population of approximately 180 experimental subjects 
and 120 control subjects. However, it was found that 
the lengthening days, approaching farming season, and 
inadequate funding were causing the enrollment to drop. 
When the pre-tests were given, only 5^ experimental sub- 
jects were enrolled and only 28 control subjects were 
enrolled. At this time, it was found that the classes 
would soon end due to lack of funds and that no time 
would be available f''r the selection of additional class- 
es to increase the size of the population. 
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Procedure 



The pre-test administered was the "Reading: 
Vocabulary: and "Reading: Comprehension" subtests of 

the Gray -Votaw -Rogers General Achievement Test, Form B , 
Primary. 19^1 Edition , 

The experimental teachers then introduced the ex- 
perimental material to their classes as o’ust "some new 
material," but used it as the core of their reading pro- 
gram with recreational reading both permitted and en- 
couraged. The teaching techniques used were those the 
teachers preferred as long as they supplemented the sug- 
gestions given in the teacher's manual. 

The control teachers continued to teach with the 
traditional materials supplied by the county. The tech- 
niques they used were the ones they preferred. 

The instructional period was for three hours 
each night, two nights each week for six weeks, or a 
total of thirty-six hours of instruction. At the end of 
this time. Form A of the above test was given as a post- 
test. 

Selection of the Sample 

At the end of the period of instruction, 35 stu- 
dents remained in the experimental classes. Thirteen 
students remained in the control classes. Those students 
who had non-regressing scores, who began at a level below 
6*9> and for whom the teachers had administered valid 
tests were selected for the final sample. 

Analysis of the Data 

The test scores for the two skills were analyzed 
separately. The raw scores were converted into grade 
level scores. The differences between each student's 
pre-test and post-test scores were obtained and are the 
gain scores analyzed. 

The assumption of normal distribution necessary 
for the Student's t analysis of the data were accepted. 
The following formula for analyzing differences between 
means was used: 
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The formula used for analyzing the difference between a 
mean gain and zero was: 



In both of the above ^ the standard deviation was accepted 
as the true parameter. The formula for determining z in 
the examination of the drop-outs was: "" 



where was equal to the number in the experimental sam- 
ple 5 Np was equal to the number in the control sample; 

N was equal to the sum of Nt and N 25 n, was equal to the 
number of pre-test to post -test drop-outs in the experi- 
mental group; n 2 was equal to the number of pre-test to 
post-test drop-outs in the control group; and, n was 
equal to the sum of n^^ and n 2 - 

The level of significance used was a ^ «io a 
one-tailed test. 

Hypotheses 

1. Ho: There is a significant difference between 

the mean gain in vocabulary made by the experimental 
group and the mean gain in vocabulary made by the con- 
trol group. 

Ha : The mean gain in vocabulary made by the ex- 

perimental group is greater than the mean gain in vocabu- 
lary made by the control group. 

2 . Ho: There is no significant difference between 

the mean gain in comprehension made by the experimental 
group and the mean gain in comprehension made by the 
control group. 

Ha: The mean gain in comprehension made by the 
experimental group is greater than the mean gain in com- 
prehension made by the control group. 

3« Ho: There is no significant difference between 

the mean gain in vocabulary made by the experimental 
group and a mean gain of zero. 
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Ha: The mean gain in vocabulary made by the ex- 

perimental group is greater than zero, 

4. Ho: There is no significant difference between 

the mean gain in vocabulary made by the control group and 
a mean gain of zero. 

Ha: The mean gain in vocabulary made by the con- 

trol group is greater than zero. 

5* Ho: There is no significant difference between 

the mean gain in comprehension made by the experimental 
group and a mean gain of zero. 

Ha The mean gain in comprehension made by the 
experimental group is greater than zero. 

6. Ho: There is no significant difference between 

the mean gain in comprehension made by the control group 
and a mean gain of zero. 

1^: The mean gain in comprehension made by the 

control group is greater than zero. 

7* Ho: There is no significant difference between 

the drop-out rate in the experimental group and the 
drop-out rate in the control group. 

Ha: The drop-out rate in the control group is 
greater than the drop-out rate in the experimental group. 

Results 

The following tables show the results given in 
grade levels. 



TABLE 1 

RESULT OP TREATMENT ON GRADE PLACEMENT IN VOCABULARY 





Mean 


Standard Deviation 


Number of Valid 


GrouD 


Gain 


of Gains 


Scores 


Experimental 


1.55 


1.17 


22 


Control 


.89 


o 
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TABLE 2 

RESULT OP TREATME21T ON GRADE PLACEMENT IN COMPREHENSION 



Group 


Mean 

Gain 


Standard Deviation 
of Gains 


Number of Valid 
Scores 


Experimental 


.67 


.85 


17 


Control 


1.39 


1.47 


7 



TABLE 3 

VALUE OP STUDENT'S t FOR THE COMPARISON OP THE GRADE 
LEVEL GAINS FOR THE GROUPS IN COLUMNS AS GREATER 

THAN THE GROUPS IN ROWS 



Vocabulary Comprehension 

Group Experimental Control Experimental Control 

Group Group Group Group 



Experimental 1.21 

Control 1.98* 

Greater than 

zero 6.21* 1.28 3-25* 2.51* 



Significant at cf^ 



.10 on a one-tailed test. 



TABI.E 4 
DROP -OUT BATES 



Group 


Per Cent of Sample 
Dropping Out 


Experimental 


355«* 


Control 


545«* 



l}(* 

Value of z when the percentage of drop-outs is 
expected to be equal within the two groups z « 1,61 
(z. is significant at the{;?( = .0537 level on“a one- 
tailed test). 



From the data, the following tests of hypotheses 

obtains 

Null hypothesis 1 ; There is no significant differ- 
ence between the mean gain in vocabulary made by the 
experimental group and the mean gain in vocabulary made 
by the control group. 

Alternate hypothesis s The mean gain in vocabulary 
made by the experimental group is greater than the mean 
gain in vocabulary made by the control group. 

The difference between the mean vocabulary gains 
was .66 grade levels, a difference significant above the 

.05 level on a one-tailed test. On this basis, the 
null hypothesis may be rejected and the alternate 
hypothesis accepted. 

Null hypothesis 2 s There is no significant differ- 
ence between the mean gain in comprehension made by the 
experimental group and the mean gain in comprehension 
made by the control group. 

Alternate hypothesis s The mean gain in comprehen- 
sion made by the experimental group is greater than the 
mean gain in comprehension made by the control group. 

Due to the nature of the data, the alternate 
hypothesis may be restated ass The mean gain in compre- 
hension made by the control group is greater than the 
gain made by the experimental group. 



The difference between the mean comprehension 
gains was .72 grade levels, a difference not signifi- 
cant above theoC^ .10 level on a one-tailed test. On 
this basis, the null hypothesis may be accepted. 

Null hypothesis There is no significant differ- 
ence between the mean gain in vocabulary made by the 
experimental group and a mean gain of zero. 

Alternate hypothesis : The mean gain in vocabulary 

made by the experimental group is greater than zero. 

The mean gain in vocabulary for the experimental 
group was 1.55 grade levels, a mean gain significantly 
greater than zero above thec<= .005 level on a one- 
tailed test. On this basis, the null hypothesis may be 
rejected and the alternate hypothesis accepted. 

NuJLl hypothesis 4 : There is no significant dif- 

ference between the mean gain in vocabulary made by the 
control group and a mean gain of zero. 

Alternate hypothesis : The mean gain in vocabulary 

made by the control group is greater than zero. 

The mean gain in vocabulary for the control 
group was .89 grade levels, a mean gain not signifi- 
cantly greater than zero at the^ = .10 level v>n a 
one-tailed test. On this basis, the null hypothesis 
is accepted. 

Null hypothesis 6 : There is no significant differ- 

ence between the mean gain in comprehension made by the 
experimental group and a mean gain of zero. 

Alternate hypothesis ; The mean gain in comprehen- 
sion made by the experimental group is greater than 
zero. 



The mean gain in comprehension made by the ex- 
perimental group was .6? grade levels, a mean gain sig- 
nificantly greater than zero above thec< = .05 level 
on a one-tailed test. On this basis, the null hypothe- 
sis may be rejected and the alternate hypothesis 
accepted . 

Null hypothesis 6 : There is no significant differ- 

ence between the mean gain in comprehension made by the 
control and a mean gain of zero. 
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Alternate hypothesis : The mean gain in comprehen- 

sion made by the control group is greater than zero. 

The mean comprehension gain made by the ex- 
perimental group was 1.39 grade levels, a mean gain 
significantly greater than zero above thec^ = .05 
level on a one-tailed test. On this basis, the null 
hypothesis may be rejected and the alternate hypothe- 
sis accepted. 

Null hypothesis 7 : There is no significant differ- 

ence between the drop-out rate in the experimental 
group and the drop-out rate in the control group. 

Alternate hypothesis : The drop-out rate in the 

control group is greater than the drop-out rate in 
the experimental group. 

The z ordinate was 1.6l, a value significant at 
the^C = ,054 level on a one-tailed test. On this basis, 
the null hypothesis may be rejected and the alternate 
hypothesis accepted. 



Discussion 



Prom the results reported above, it may be seen 
that the experimental group gained over one and one- 
half grade levels in vocabulary with thirty -six hours 
of instruction. It is difficult to believe that this 
much gain took place without a like gain being made in 
comprehension as seen in Table 2. It is further hard to 
put faith in the gains shown by the control group because 
of the disparity of gains in vocabulary and comprehension. 
Also, the raw data contained several regressing scores 
and scores for some students that were invalidated be- 
cause the teacher failed to end the test at the appro- 
priate time. This indicates that the test results must 
be interpreted with caution. 

Table 4 shows that the experimental group lost 
35^ of the students between the pre-test and the post- 
test, while during the same period the control group 
lost 54 ^ of its students. It may be that the subject 
mortality of the two groups was not necessarily for the 
same reasons. 

Conclusions and Recommendations 

Although the hypotheses may be tested for the 
data gathered, and although this may give an indication 
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of the results that may be expected from such a teacher- 
pupil population, it is recommended that no generaliza- 
tions about the relative worth of the materials or pro- 
grams be drawn from this data. It was concluded that 
the gain study should be replicated. 



Study Two 

During the summer of 1967 > the first study was 
replicated with a much larger population. 

Method 



Selection of Population 

With the aid of Dr. Weldon Bradtmueller and 
others in the Florida State Department of Education, the 
investigator was able to obtain twenty classes to act as 
experimental population for the replication of the gain 
study. 



The study took place in central and southern 
Florida as an incidental part of the Migrant and Season- 
al Workers Project. The experimental classes were cho- 
sen from the total population of classes of that project 
by randomly distributing the experimental materials to 
teachers who had expressed a desire to use them and 
whose administrators had no objection to the experimen- 
tation. At least one experimental class was obtained 
in all except one of the counties participating in the 
Project. The remaining population of classes acted as 
control population. 

Selection of Sample 

The control groups reported are a random sample 
stratified to the extent that classes were drawn from 
each county from which valid experimental data was ob- 
tained. The entire population of experimental subjects 
on whom valid data was obtained is reported. 

There were several criteria used to determine 
the validity of cases for consideration. They were: 

(1) taking at least one class of students from each of 
the counties participating in the project, (2) foreign 
born students who were learning to read a new language 
were excluded from the experimental and the control 
populations, (3) all cases were required to have all 
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test data complete before being considered valid, (4) 
scores initially above the difficulty level of the ex- 
perimental material were discarded. 

In both the experimental and control populations, 
the sample was first drawn, then invalid pairs of pre- 
test and post-test scores were discarded. This yielded 
unequal sample sizes for all groups except the combined 
experimental group. 

Procedure 

The teachers of al3- classes gave one week*s in== 
struction to familiarize the students with their new 
surroundings before the pre-test was administered. The 
pre-test consisted of the "Word Recognition” and "Read- 
ing Comprehension" sections of the Adult Basic Education 
Student Survey— Pom A , ~ 

Classes were held for a total of 420 hours of 
instruction, an equivalent amount of that time being 
used for reading instruction in both the experimental 
and control classes. At the end of the instructional 
period. Form B of the above test was administered as a 
post-test. 

The experimental materials were used as the core 
of the reading program, and the methods used by the ex- 
perimental teachers and the methods and materials used 
in the control classes were as described for Study One. 

Analysis of the Data 

The data was sub-divided for analysis in the 
following manner. 

1. Those cases having an initial ability in either 
skill below the level at which the first package of 
experimental material ends (3.9) were placed in the low 
Initial ability group for that skill. 

2. Those cases having an initial ability in either 
skill above the level at which the second package of 
experimental material begins (4.0) were placed in the 
high initial ability group for that skill. 

3. The two above groups were Jointly analyzed as a 
combined group. 
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An examination of the raw data showed several 
regressing scores in every group. These cases were re- 
moved for the respective skill and the dava re-analyzed. 

Those cases having an Initial ability in either 
skill below the level at which the first package of 
experimental material begins (1.75) were removed from 
the low initial ability group and the data from that 
group was re -analyzed. 

The test scores for the two skills were analyzed 
separately. The assumptions necessary for the Student *s 
t analysis of the data were accepted. The following 
formula for analyzing the difference between means was 
used: 




The standard deviations were accepted as the true 
parameters • 

The level of significance used was = .10 on 
a one-tailed test. 

Hypotheses 

1. Ho: There is no significant difference between 

the mean post -test vocabulary grade level of the experi- 
mental group and the mean post -test vocabulary grade 
level of the control group. 

Ha : The mean post -test vocabulary grade level 

of the experimental group is greater than the mean post- 
test vocabulary grade level of the control group. 

2. Ho: There is no significant difference between 

the mean post-test vocabulary grade level of the experi- 
mental group and the mean pre-test vocabulary grade 
level of the experimental group. 

Ha : The mean post-test vocabulary grade level 

of the experimental group is greater than the mean pre- 
test vocabulary grade level of that group. 

3. Ho: There is no significant difference between 

the mean post -test vocabulary grade level of the control 




group and the mean pre-test vocabulary grade level of 
the control group, 

Ha: The mean post -test vocabulary grade level 

of the control group is greater than the mean pre-test 
vocabulary grade, level of that group. 

S&5 There is no significant difference between 
the mean post-test comprehension grade level of the 
experimental group and the mean post-test comprehension 
grade level of the control group. 

Ha: The mean post-test comprehension grade 

level of the experimental group is greater than the mean 
post-test comprehension grade level of the control group. 

3 * Ho: There is no significant difference between 

the mean post-test comprehension grade level of the 
experimental group and the mean pre-test comprehension 
grade level of the experimental group. 

Ha: The mean post-test comprehension grade 

level of the experimental group is greater than the mean 
pre-test comprehension grade level of that group. 

6. Ho: There is no significant difference between 

the mean post-test comprehension grade level of the 
control group and the mean pre-test comprehension grade 
level of the control group. 

Ha: The mean post -test comprehension grade 

level of the control group is greater than the mean 
pre-test comprehension grade level of that group. 

Since all students received a stipend for attend- 
ing classes, any affect of interest of material on drop- 
out rate would be reduced to an insignificant value by 
the contaminating monetary factor. For this reason, the 
drop-out rates of the experimental and control groups 
are not considered in this study. 

Results 



The following tables show the results given in 
grade levels. 






TABLE 3 

PRE-TEST AMD POST-TEST RESULTS GIVEN IM GRADE LEVELS 

FOR ALL VALID CASES 





Vocabulary 


Comorehension 


Groups 


Pre- 

test 

Mean 


Post- 

test 

Mean 


N 


Pre- 

test 

Mean 


Post- 

test 

Mean 


N 


ExDerimental 


Low Initial Ability 


2.73 


3.27 


22 


2.58 


3.57 


46 


High Initial Ability 


5.37 


6.02 


64 


5.18 


6.33 


40 


Combined Groups 


4.70 


5.31 


86 


3.79 


4.85 


86 


Control 


Low Initial Ability 


2.67 


3.65 


31 


2.27 


3.50 


84 


High Initial Ability 


5.33 


5.57 


88 


5.09 


6.17 


61 


Combined Groups 


4.64 


5.07 119 


3.45 


4.62 


145 
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TABLE 6 



VALUE OP STUDENT »S t FOR THE COMPARISON OP SCORES IN 
ROWS AS GREATER THAN SCORES IN COLUMNS— ALL 
VALID VOCABULARY SCORES 



Groups 


Experimental 

Group 


Control GrouD 




Pre-test 


Post-test 


Pre-test 


Experimental 








Low Initial Ability 








Pre-test 

Post-test 


1.64* 


1 

. 

CD 


.34 


High Initial Ability 








Pre-test 

Post-test 


3.76* 


2.23* 


.33 


Combined 








Pre-test 
Post -test 


2.98* 


1.96* 


.35 


Control 








Low Initial Ability 








Post-test 






5.16* 


High Initial Ability 








Post-test 






1.49* 


Combined 








Post-test 






2.15* 



Values significant at the a = .lO level on a 
one-tailed test. 



o 
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TABLE 7 



VALUES OF STUDENT'S t FOR THE COMPARISON OF SCORES IN 
ROWS AS GREATERTTHAN SCORES IN COLOMNS—ALL 
VALID COMPREHENSION SCORES 



Groups 


Experimental 

GrouD 


Control GrouD 


Pre-test 


Post -test 


Pre-test 


ExDerlmental 








Low Initial Ability 








Pre-test 

Post-test 


3.74* 


.23 


2.39* 


High Initial Ability 








Pre-test 

Post-test 


6.65* 


.93 


.44 


Combined 








Pre-test 

Post-test 


4.03* 


.88 


1.64* 


Control 








Low Initial Ability 








Post-test 






6.31* 


High Initial Ability 








Post -test 






7.30* 


Combined 








Post-test 






5.71* 



Values significant at the a - .10 level on a 
one-tailed test. 



o 
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TABLE 8 



PRE-TEST AND POST-TEST RESULTS GIVEN IN GRADE 
LEVELS FOR VALID CASES AFTER THE 
REMOVAL OP REGRESSING SCORES 





Vocabulary 


Comnrehension 


•• 

• • 

Groups 


Pre- 

test 

Mean 


Post- 

test 

Mean 


N 


Pre- 

test 

Mean 


Post- 

test 

Mean 


N 


ExDerimental 


Low Initial Ability 


2.73 


3.97 


15 


2.55 


4.09 


34 


High Initial Ability 


5.37 


6.51 


48 


4.98 


6.65 


31 


Combined Groups 


4.74 


5.90 


63 


3.71 


5.31 


65 


Control 


Low Initial Ability 


2.73 


4.15 


25 


2.29 


3.78 


72 


High Initial Ability 


5.21 


6.12 


57 


5.05 


6.57 


49 


Combined Groups 


4.45 


5.52 


82 


3.41 


4.91 


121 
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TABLE 9 



VALUE OP STUDENT »S t FOR THE COMPARISON OP SCORES IN 
ROWS AS GREATER ®EIAN SCORES IN COLUl'iNS— VALID 
VOCABULARY SCORES AFTER THE REMOVAL 
OP REGRESSING SCORES 



Groups 


Experimental 

Group 


Control Group 




Pre-test 


Post-test Pre-test 



Experimental 



Low Initial Ability 



Pre-test 

Post-test 


3.84* 


-.41 


.00 


High Initial Ability 








Pre-test 

Post-test 


6.48* 


1.93* 


.99 


Combined 








Pre-test 

Post-test 


4.44* 


1.50* 


1.22 


Control 








Low Initial Ability 








Post-test 






4.30* 


High Initial Ability 








Post-test 






5.00* 


Combined 




** 




Post-test 






4.69* 



Values significant at the a * .10 level on a 
one-tailed test. 



TABLE 10 



VALUE OP STUDENT *S t FOR TEIE COMPARISON OP SCORES IN 
ROWS AS GREATER“THAN SCORES IN COLUMNS— VALID 
COMPREHENSION SCORES AFTER THE REMOVAL 
OP REGRESSING SCORES 



Groups 


Experimental 

GrouD 


Control GrouD 


Pre-test 


Post-test Pre-test 


ExDerimental 

Low Initial Ability 
Pre-test 




1.59* 


Post-test 


5.13* 


1.01 


High Initial Ability 
Pre-test 




-.46 


Post-test 


7.63* 


.37 


Combined 

Pre-test 




i.as 


Post-test 


5.56* 


1.39* 


Control 






Low Initial Ability 
Post-test 




8.32* 


High Initial Ability 
Post-test 




10.48* 


Combined 

Post-test 




6.70* 



* 

Values significant at the a * ,10 level on a 
one-tailed test. 



o 
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TABLE 11 



PRE-TEST AND POST-TEST RESULTS GIVEN IN GRADE LEVELS FOR 
VALID CASES AFTER THE REMOVAL OF REGRESSING SCORES AND 
LOW INITIAL ABILITY GROUP SCORES BEGINNING BELOW THE 
LEVEL OF THE EXPERIMENTAL MATERIAL 





Vocabulary 


Comorehension 


Groups 


Pre- 

test 

Mean 


Post- 

test 

Mean N 


Pre- 

test 

Mean 


Post- 

test 

Mean 


N 


Experimental 












Low Initial Ability 


3.09 


4.40 12 


2.73 


4.21 


29 


Control 












Low Initial Ability 


3.34 


4.25 18 


2.90 


4.58 


42 



31 
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TABIiE 12 



VALUE OF STUDENT'S t FOE THE COMPARISON OF SCORES IN ROWS 
AS GREATER THAN SCbRES IN COLUMNS— VALID SCORES AFTER 
THE REMOVAL OF REGRESSING SCORES AND LOW INITIAL 
ABILITY GROUP SCORES BEGINNING BELOW THE LEVEL 
OF THE EXPERIMENTAL MATERIAL 







Experimental 

GrouD 


Control Group 


Groups 




Pre-test 


Post-test 


Pre-test 


Vocabularv 










ExDerlmental 










Low Initial 


Ability 








Pre-test 

Post-test 




3.62» 


.48 


-.60 


Control 










Low Initial 


Ability 








Post -test 






3.21* 




Comorehension 










ExDerimental 










Low Initial 


Ability 








Pre-test 

Post-test 




4.70* 


“1.01 


“1.12 


Control 










Low Initial 


Ability 








Post-test 






7.03* 





Values significant at the a » .10 level on a 
one-tailed test. 
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Prom the data^ the following tests of hypotheses 

obtain: 

Null hypothesis Is There is no significant differ- 
ence between the mean post-test vocabulary grade level 
of the experimental group and the mean post -test vocabu- 
lary grade level of the control group. 

Alternate hypothesis : The mean post-test vocabulary 

grade level of the experimental group is greater than 
the mean post-test vocabulary grade level of the con- 
trol group. 

Low initial ability group : The control group ob- 

tained a mean post-test vocabulary grade level .38 
levels higher than that obtained by the experimental 
group. This difference is not significant at the 
a = .10 level on a one-tailed test. On this basis, the 
null hypothesis may be accepted. 

ligh_in itial ability group ; The experimental group 
obtained a mean post-test vocabulary grade level .45 
levels higher than that obtained by the r >ntrol group. 

This difference is significant above the a « .025 level 
on a one-tailed test. On this basis, the null hypothe- 
sis may be rejected and the alternate hypothesis accepted. 

Combine d groups ; The experimental group obtained a 
mean post-test vocabulary grade level .24 levels higher 
than that obtained by the control group. This differ- 
ence is significant above the a = .05 level on a one- 
tailed test. On this basis, the null hypothesis may be 
rejected and the alternate hypothesis accepted. 



After Removing Regressing Scores 

Low initial ability group : The control group ob- 

tained a mean post-test vocabulary grade level .08 
levels higher than that obtained by the experimental 
group. This difference is not significant at the 
a = .10 level on a one-tailed test. On this basis the 
null hypothesis may be accepted. 

High in itial ability group : The experimental group 

obtained a mean post-test vocabulary grade level .39 
levels higher than that obtained by the control group. 
This difference is not significant above the a ~ .10 
level on a one-tailed test. On this basis, the null 
hypothesis may be accepted. 



Combined groups ; The experimental group obtained a 
mean post “test vocabulary grade level .38 levels higher 
than that obtained by the control group. This differ- 
ence is not significant at the a =* .10 level on a one- 
tailed test. On this basis, the null hypothesis may 
be accepted. 



After Removing Both Regressing Scores and Initial Scores 
Below the Beginning Level of the Experimental Material 

Low_ initial ability: grou p; The experimental group 
obtained a mean post-test vocabulary grade level .15 
levels above that obtained by the control group. This 
difference is not significant above the a » .10 level 
on a one-tailed test. On this basis, the null hypothe- 
sis may be accepted. 

Null hy pothesis 2 : There is no significant differ- 

ence between the mean post -test vocabulary grade level 
of the experimental group and the mean pre-test vocabu- 
lary grade level of the experimental group. 

Alterna te hypothesis : The mean post-test vocabulary 

grade level of the experimental group is greater than 
the mean pre-test vocabulary grade level of that group. 

Low Initial ability group : In the experimental 

group, the low Initial ability group obtained a mean 
post-test vocabulary grade level .54 levels higher than 
that obtained on the pre-test. This difference is sig- 
nificant above the a « .10 level on a one-tailed test. 

On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

High i nitial ability group ; In the experimental 
group, the high initial ability group obtained a mean 
post-test vocabulary grade level .65 levels higher than 
that obtained on the pre-test. This difference is sig- 
nificant above the a - .0005 level on a one-tailed test. 
On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

Qombined groups : In the experimental group, the 

combined ability groups obtained a mean post-test 
vocabulary grade level .61 levels higher than that ob- 
tained on the pre-test. This difference is significant 
aboye the a = ,005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the alter- 
nate hypothesis accepted. 
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After Removing Regressing Scores 

Low initial ability group ; In the experimental group, 
the low initial ability group obtained a mean post-test 
vocabulary grade level 1,24 levels higher than that ob- 
tained on the pre-test • This difference is significant 
above the a = .005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the 
alternate hypothesis accepted. 

High initial ability group : In the experimental 

group, the I igh initial ability group obtained a mean 
post-test vocabulary grade level l.l4 levels higher than 
that obtained on the pre-test. This difference is sig- 
nificant above the a * .0005 level on a one-tailed test. 
On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

Combined group ; In the experimental group, the 
combined ability groups obtained a mean post-test vocabu- 
lary grade level l.l6 levels higher than that obtained 
on the pre-test. This difference is significant above 
the a = .0005 level on a one-tailed test. On this basis, 
the null hypothesis may be rejected and the alternate 
hypothesis accepted. 



After Removing Both Regressing Scores and Initial Scores 
Below the Beginning Level of the Experimental Material 

Low initial ability group ; In the experimental group, 
the low initial ability group obtained a mean post-test 
vocabulary grade level 1.31 levels higher than that ob- 
tained on the pre-test. This difference is significant 
above the a * .005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the 
alternate hypothesis accepted. 

N ull hypothesis 3 ; There is no significant differ- 
ence between the mean post -test vocabulary grade level 
of the control group and the mean pre-test vocabulary 
grade level of the control group. 

Alternate hypothesis : The mean post-test vocabulary 

grade level of the control group is greater than the 
mean pre«test vocabulary grade level of that group. 

Low initial ability group ; In the control group, 
the low initial ability group obtained a mean post -test 
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vocabulary grade level .98 levels higlier than that ob- 
tained on the pre-test# This difference is significant 
above the a ^ .0005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the alter- 
nate hypothesis accepted. 

High initial ability group ; In the control group, 
the high initial ability group obtained a mean vocabulary 
grade level .24 levels higher than that obtained on the 
pre-test. This difference is significant above the 
a = .10 level on a one-tailed test. On this basis, the 
null hypothesis may be rejected and the alternate hypothe- 
sis accepted. 

Combined groups ; In the control group, the combined 
ability groups obtained a mean post-test vocabulary grade 
level .43 levels higher than that obtained on the pre- 
test. This difference is significant above the a = .025 
level on a one-tailed test. On this basis, the null 
hypothesis may be rejected and the alternate hypothesis 
accepted. 



After Removing Regressing Scores 

Low initial ability group : In the control group, 

the low initial ability group obtained a mean post- 
test vocabulary grade level 1.42 levels higher than that 
obtained on the pre-test. This difference is signifi- 
cant above the a = .0005 level on a one-tailed test. 

On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

High initial ability group : In the control group, 

the high initial ability group obtained a mean post-test 
vocabulary grade level ,91 levels higher than that ob- 
tained on the pre-test. This difference is significant 
above the a = .0005 level on a one-tailed test. On 
this basis, the null hypothesis may be rejected and the 
alternate hypothesis accepted. 



After Removing Both Regressing Scores and Initial Scores 
Falling Below the Beginning Level of the Experimental 
Material. 

Low initial ability group ; In the control group, the 
low initial ability group obtained a mean post-test vo- 
cabulary grade level 1.01 levels higher than that obtained 
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on the pre-test. This difference is significant above 
the a s= .0005 level on a one-tailed test. On this 
basis^ the null hypothesis may be rejected and the 
alternate hypothesis accepted. 

Null hypothesis 4 : There is no significant differ- 

ence between the mean post-test comprehension grade 
level of the experimental group and the mean post-test 
comprehension grade level of the control group. 

Alternate hypothesis : The mean post-test comprehen- 

sion grade level of the experimental group is greater 
than the mean post-test comprehension grade level of the 
control group. 

Low initial ability group ; The experimental group 
obtained a mean post-test comprehension grade level .07 
levels higher than that obtained by the control group. 
This difference is not significant at the a = .10 level 

on a one-tailed test. On this basis, the null hypothe- 

sis may be accepted. 

High initial ability group : The experimental group 

obtained a mean post-test comprehension grade level .14 
levels higher than that obtained by the control group. 
This difference is not significant at the a = .10 level 

on a one-tailed test. On this basis, the null hypothe- 

sis may be rejected. 

Combined g:rouDs ; The experimental group obtained a 
post-test comprehension grade level .23 levels higher 
than that obtained by the control group. This differ- 
ence is not significant at the a = .10 level on a one- 
tailed test. On this basis, the null hypothesis may 
be accepted. 



After Removing Regressing Scores 

Low initial ability group : The experimental group 

obtained a mean post-test comprehension grade level .31 
levels higher than that obtained by the control group. 
This difference is not significant at the a * .10 level 
on a one-tailed test. On this basis, the null hypothe- 
sis may be accepted. 

Hig:h initial ability group : The experimental group 

obtained a mean post -test comprehension grade level .08 
levels higher than that obtained by the control group. 
This difference is not significant at the a - .10 
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level on a one-tailed test. On this basis, the null 
hypothesis may be accepted. 

Combined_groups : The experimental group obtained a 

post -test comprehension grade level .40 levels higher 
than that obtained by the control group. This differ- 
ence is significant above the a = .10 level on a one- 
tailed test. On this basis, the null hypothesis may 
be rejected and the alternate hypothesis accepted. 



After Removing Regressing Scores and Initial Scores 
Palling Below the Beginning Level of the Experimental 
Material. 

Low initial ability group : The control group ob- 

tained a mean post-test comprehension grade level .37 
levels higher than that obtained by the experimental 
group. This difference is not significant at the 
a = .10 level on a one-tailed test. On this basis the 
null hypothesis may be accepted. 

Null hy pothesis B: There is no significant differ- 

ence between the mean post-test conprehension grade 
level of the experimental group and the mean pre-test 
comprehension grade level of the experimental group. 

Alternate, hypothesis : The mean post-test comprehen- 

sion grade level of the experimental group is greater 
than the mean pre-test comprehension grade level of that 
group . 

Low ini tial ability group ; In the experimental group 
the low initial ability group obtained a mean post -test 
comprehension grade level ,99 levels higher than that 
obtained on the pre-test. This difference is significant 
above the a = .0005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the alter- 
nate hypothesis accepted. 

High initial ability group : In the experimental 

group, the high initial ability group obtained a mean 
post-test comprehension grade level 1,15 levels higher 
than that obtained on the pre-test. This difference is 
significant above the a = .0005 level on a one-tailed 
test. On this basis, the null hypothesis may be re- 
jected and the alternate hypothesis accepted. 

Combined jsroups ; In the experimental group, the 
combined ability groups obtained a mean post -test 



comprehension grade level 1.06 levels higher than that 
obtained on the pre-test. This difference is signifi- 
cant above the a = .0005 level on a one-tailed test. 

On this basis 5 the null hypothesis may be rejected and 
the alternate hypothesis accepted. 



After Removing Regressing Scores 

Low initial ability group : In the experimental 

group j the low initial ability group obtained a mean 
post-test ccmiprehension grade level 1.5^ levels above 
that obtained on the pre-test. This difference is sig- 
nificant above the a = .0005 level on a one-tailed test. 
On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

High initial ability group : In the experimental 

group, the high initial ability group obtained a mean 
post-test comprehension grade level 1.67 levels higher 
than that obtained on the pre-test. This difference is 
significant above the a « .0005 level on a one-tailed 
test. On this basis, the null hypothesis may be re- 
jected and the alternate hypothesis accepted. 

Combined groups : In the experimental group, the 

combined ability groups obtained a mean post-test 
ccaaprehension grade level 1.60 levels higher than that 
obtained on the pre-test. This difference is signifi- 
cant above the a « .0005 level on a one-tailed test. On 
this basis, the null hypothesis may be rejected and the 
alternate hypothesis accepted. 



After Removing Both Regressing Scores and Initial Scores 
Palling Below the Beginning Level of the Experimental 
Material 

Low Initial ability group ; In the experimental group, 
the low initial ability group obtained a mean post-test 
comprehension grade level 1.48 levels higher than that 
obtained on the pre-test. This difference is significant 
above the a = .005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the alter*’ 
nate hypothesis accepted. 

Null hypothesis 6' s There is no significant differ- 
ence between the mean post-test comprehension grade 
level of the control group and the mean pre-test compre- 
hension grade level of the control group. 
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Alternate hypothesis : The mean post -test compre- 

hension grade level of the control group is greater than 
the mean pre-test comprehension grade level of that 
group. 

Low initial ability group ; In the control group, the 
low initial ability group obtained a mean post -test com- 
prehension grade level 1,13 levels higher than that ob- 
tained on the pre-test. This difference is significant 
above the a = .0005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the 
alternate hypothesis accepted. 

High initial ability group : In the control group, 

the high initial ability group obtained a mean post- 
test comprehension grade level 1,08 levels higher than 
that obtained on the pre-test. This difference is sig- 
nificant at the a « ,0005 level on a one-tailed test. 

On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

Combined groups ; In the control group, the combined 
ability group obtained a mean post-test comprehension 
grade level 1,17 levels higher than that obtained on 
the pre-test. This difference is significant above the 
a = ,0005 level on a one-tailed test. On this basis, 
the null hypothesis may be rejected and the alternate 
hypothesis accepted. 



After Removing Regressing Scores 

Low initial ability group : In the control group, 

the low initial ability group obtained a mean post- 
test comprehension grade level 1.49 levels higher than 
that obtained on the pre-test. This difference is sig- 
nificant above the a « ,005 level on a one-tailed test. 
On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 

High initial ability group : In the control group, 

the high initial ability group obtained a mean post- 
test comprehension grade level 1.52 levels higher than 
that obtained on the pre-test. This difference is sig- 
nificant above the a - .0005 level on a one-tailed test. 
On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted. 
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Combined groups ; In the control group, the combined 
initial ability groups obtained a mean post-test com- 
prehension grade level 1.50 levels higher than that ob- 
tained on the pre-test. This difference is significant 
above the a - .0003 level on a one-tailed test. On 
this basis, the null hypothesis may be rejected and the 
alternate hypothesis accepted. 



After Removing Both Regressing Scores and Initial Scores 
Falling Beloif the Beginning Level of the Experimental 
Material 

Low initial ability group : In the control group, the 

low initial ability group obtained a mean post-test 
^comprehension grade level 1.68 levels higher than that 
obtained on the pre-test. This difference is significant 
above the a = .0005 level on a one-tailed test. On this 
basis, the null hypothesis may be rejected and the alter- 
nate hypothesis accepted. 

Discussion 



The county records were to clearly show all stu- 
dents participating in the experimental condition. It 
is unfortunate that this obvious condition was not met 
by all counties and that much valuable data was lost 
through the exclusion of these counties. For this 
reason, several experimental classes had to be discarded, 
and the control population from these counties could not 
be sampled. 

Two factors added variability to the data. The 
first is the fact that there was major rioting during 
the time the post -tests were given. It was not Imown if 
this factor influenced both experimental and control 
groups equally. Further, it was not known if the in- 
fluence would increase or decrease the mean post-test 
grade levels. 

The second factor is the fact that afternoon 
thundershowers were occurring at the time of many post- 
tests. Teachers reported that the student population 
was highly superstitious and felt that paper would "drawf” 
lightning. For this reason, many of the students were 
reported as being very fearful during the post-testing. 

It was assumed that the post-test scores of both the 
experimental and control groups were lowered equally by 
this phenomina. 







41 



From the results reported above, it can be seen 
that all groups showed significant post-test over pre- 
test levels. It may also be noted that the experimental 
group had post-test grade levels significantly higher 
than those of the control group in vocabulary for the 
high initial ability and combined ability groups for all 
valid scores, for the same scores after the removal of 
regressing scores, and in comprehension for the combined 
ability groups after removing regressing scores. How- 
ever, it should be noted that the mean pre-test scores 
in comprehension of the combined ability groups after 
removing regressing scores were near significance in 
difference. 



Conclusions 



These authors concluded from the results of this 
study that: (1) both the experimental and traditional 

materials provided for significant growth in the skills 
tested, and (2) the experimental material showed sig- 
nificant superiority over the traditional materials, 
when correction was made for regressing scores. 

Since the experimental material was of an ex- 
perimental edition, without the benefit of professional 
printing and editing it is probable that the experimental 
material, if published, would prove to be a significant- 
ly better material them those traditional materials 
available at the time of these studies. 
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PART III 



THE ACCEPTANCE STUDIES 
Study One— The Student Acceptance Study 



Method 



Selection of the Sample 

The northern Florida gain study experimental 
students were used as the sample for the student accept- 
ance study* 

Procedure 



Following the post-test, the subjects were asked 
to compare the experimental material with other materi- 
als they had used and to rate the experimental material 
on a three point scale. 

Expressed Interest 

The ratings made by the students on the first 
half of "a Provisional Scale for Pupil Evaluation of 
Adult Basic Education Training Materials” (copy in 
Appendix A) constituted a measure of their expressed 
Interest level in the experimental material. 

Relative Interest 

The comparisons made by the students on the 
second half of the above instrument constituted a 
measure of the relative Interest values of the materials 
compared. 

Analysis of the Data 
Expressed Interest 

The mean^ median, and modal ratings have been 
reported. The (chi square) statistical test for sig- 
nificant difference between the obtained distribution 
and the theoretical random distribution ^s been used. 
The formula for the one sample test of X^ used was: 

(oi - 

% 
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where O 4 equaled the observed number of cases categorized 
in the ith category; equaled the expected niimber of 
cases in the ith category under Ho; and ^ was the 
direction to sum over all (k) categories i=*l 



Relative Interest 

The number of responses in each category, the 
mean, median, and modal responses, and the statistic 
(when the expected frequency was greater than five) 
have been reported. The formula used for X^ was as 
reported above. 

Hypotheses 

1 . Ho: The expressed interest ratings obtained from 

the students do not differ significantly from a random 
distribution on a three point scale. 

Ha ; The expressed interest ratings obtained from 
the students are not all equal. 

2. Ho; The relative interest ratings obtained from 
the students for each comparison do not differ signifi- 
cantly from a random distribution on a three point scale. 

Ha : The relative interest ratings obtained from 

the students are not all the same, within each compari- 
son. 

Results 



Expressed Interest 



A total of 38 valid responses were obtained on 
the expressed interest scale. The median and modal 
ratings were both 1 and the mean rating was 1.08. A 
rating of 1 was "good," 2 was "all right," and 3 was 
"bad.^ 

Having assimied a random distribution of the 
ratings would result if the scale were completed by a 
population completely.unfamiliar with the material justi- 
fied the use of the X^ statistical test of significance. 
For the obtained distribution, X^ was greater than 57 • 
This value is significaint above the a =.001 level. On this 
basis, null hypothesis one, above, may be rejected and 
the alternate hypothesis accepted. 



Relative Interest ♦ 

A total of 116 valid responses were obtained on 
the relative interest scale. The results are presented 
in Table 13 . Prom Table 13 the following tests of 
hypothesis two obtain: 

Null hypothesis 2 : The relative interest ratings ob- 

tained from the students for each comparison do not dif- 
fer significantly from a random distribution on a three 
point scale. 

Alternate hypothesis : The relative interest ratings 

obtained from the students are not all the same within 
each comparison. 

Por Life On Our Earth. We Are What We Eat . Adult 
Reader . I Want to Read and Write, the S.R. A. Reading 
Laboratories, The New Practice Readers, and the combined 
Pollett program the sample sizes were not large enough 
for the test of significamce and the null hypothesis 
could not be tested. 

Por My Country , the value was 1.6. This 
value is not significant at the a ~ .10 level. On this 
basis, the null hypothesis may be accepted for the com- 
parison of this material to the experimental material. 

Por the combined Steck program, the X^ value was 
13*1* This value is significant above the a = .01 level. 
On this basis, the null hypothesis may be rejected and 
the alternate hypothesis accepted for the comparison of 
this material to the experimental material. 

p Por the combined Reader's Digest program, the 
X^ value was 3«3# This value is significant above the 
a = .01 level. On this basis, the null hypothesis may 
be rejected and the alternate hypothesis accepted for 
the comparison of this material to the experimental 
material. 

Por the teacher-made materials, the X^ value was 
4.3 • This value is not significant at the a * .10 level. 
On this basis, the null hypothesis may be accepted for 
the comparison of this material to the experimental 
material. 

Por the combination of all materials, the X^ 
value was 20.4. This value is significant above the 
a = .001 level. On this basis, the null hypothesis may 
be rejected and the alternate hypothesis accepted. 
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Sample slse too small for 



Discussion 



The expressed interest ratings showed that the 
students sampled considered the experimental material 
interesting. The relative interest ratings showed none 
of the traditional materials or programs to have been 
significantly more interesting than the experimental 
material. If the "more interesting" material were to be 
defined as that material having had a distribution on 
the relative interest scale significantly different from 
a random distribution at thea~.10 level and having been 
the material of that comparison that had the greater 
number of responses lying on its respective side of the 
median of the scale, then the following would be 
obtained: 

P 

No material tested under the X statistic was 
considered more interesting than the experimental mate- 
rial, and the experimental material was considered more 
interesting than the Header's Digest combined program. 

If the definition were to be extended to include com- 
bined rating distributions, then the experimental 
material was considered more interesting than any of 
the materials combined into the Steck program. 

Those materials with sample sizes tpo small to 
be tested under the IKr statistic were inspected to show 
trends. None of the materials had two of the three 
measures of central tendency greater than 2. However, 
two of the materials— the S.H.A* Reading Laboratories 
and The New Practice Readers — -had all of the three 
measures of central tendency less than 2. This indicat- 
ed that none of the materials not tested under the 
statistic were considered more interesting than the ex- 
perimental material, and that the experimental material 
was considered more Interesting than the two materials 
specified above. 



Conclusions 



It may be concluded from the above that none of 
the materials used by the experimental students prior to 
the introduction of the experimental material or in use 
concurrently as recreational reading material was con- 
sidered more Interesting than the experimental material, 
and that the experimental material was considered more 
Interesting than some of the comparison materials. 



study Two— The Teacher Acceptance Study 



Method 



Selection of the Sample 

The teachers who participated in the northern 
Florida gain study as experimental teachers were used 
as the sample for the teacher acceptance study. 

Procedure 



The teachers were asked to compare the experi- 
mental material to other materials they had used. This 
comparison was made^ at the time of the post-testing^ 
by the teachers* completion of ”A Provisional Scale for 
Teacher Evaluation of Adult Basic Education Materials" 
(copy in Appendix A) . The scale was completed by the 
teachers for each program of materials they had pre- 
viously used. 

Analysis of the Data 

The mean^ median^ and modal ratings given by the 
teachers for each comparison have been given for inspec- 
tion. 

Ob.lectives 

The objective of this study was descriptive: to 

have determined whether or not the teachers accepted the 
experimental material as an adequate teaching tool. 

Results 



Each material or program that was rated by more 
than two teachers has been included in Table 14. 

Discussion 



Of the eight materials or programs rated, only 
four were rated by more than two teachers. One of these, 
Mv Country, was authored by the Principal Investigator 
of this study. This shed some doubt as to the validity 
of the ratings of that material. 

An examination of the median and modal ratings 
tended to show that the experimental material was 
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TABI£ 14 



A SUMMABY OP RESPONSES MADE BY TEACHERS TO 
EACH QUESTION ON THE SCAIS 



Program Mean Median Modal Number of 

or Material Rating Rating Rating Respondents 



Question 1: How useful do you 

teaching tool? 


feel the 


material 


is 


\ as a 


Experimental 




9.5 


10 


10 




8 


Mv Country 




9.7 


10 


10 




3 


Reader's Digest 




8.8 


9 


9 




4 


Steck program 




9.0 


9.5 


10 




4 


Question 2: How easy 

material? 


do you feel it is 


to use the 




Experimental 




9.5 


10 


10 




8 


My Country 




9.7 


10 


10 




3 


Reader's Digest 




7.8 


6 


6 




4 


Steck program 




8.8 


8.5 


8 




4 


Question 3: Would you like to use the material 

core of your reading program? 


as 


a 


Experimental 




9c5 


10 


10 




8 


My Country 




10.0 


10 


10 




3 


Reader's Digest 




7.0 


5 


5 




4 


Steck program 




8.8 


8.5 


8 




4 


Question 4: How much interest did most 

show in the material? 


of your 


students 


Experimental 




9.8 


10 


10 




8 


My Country 




10.0 


10 


10 




3 


Reader's Digest 




8.7 


9.0 


9.0 




4 
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TABLE l4«** "Contlnued 



Program 
or Material 


Mean 

Batins: 


Median 

Ratine 


j^dal Number of 
Ratine Respondents 


Steck program 


9.5 


9.5 


none 


4 


Question Dp you 

use in 


think the material is appropriate for 
ABE classes? 


Experimental 


9.6 


10 


10 


8 


My Country 


8.0 


9 


9 


3 


Reader <s Digest 


7.8 


7 


7 


4 


Steck program 


9.5 


9.5 


none 


4 



Question 6: If the material was modestly priced would 

you recommend that it be bought for your 
adult program? 



Experimental 


9.9 


10 


10 


a 

o 


My Country 


10.0 


10 


10 


3 


Reader *s Digest 


9.5 


10 


10 


4 


Steck program 


9.8 


10 


10 


4 



accepted as an equally or a more adequate teaching tool 
than the other materials used by these teachers. 

Conclusions and Recommendations 

The data tended to show acceptance of the experi- 
mental material. However^ the small sample size led the 
investigators to conclude that an additional study with 
defined programs of materials should be undertaken using 
a larger sample. 
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study Three— The Institute Trainee Acceptance Study 



Method 



Election of the Sample 

The teachers attending the Region IV Adult Basic 
Education Teacher Training Institute held in Tallahassee, 
Florida were asked to rate six programs of materials in- 
tended for use in teaching reading to adult basic edu- 
cation students according to several attributes or 
qualities of such materials. 

Procedure 

The rating was conducted by liaving the teachers 
complete A Scale for Evaluation of Adult Basic Educa- 
tion Instructional Materials" (copy in Appendix A) . 

The teachers completed the ratings three different times. 
The first rating was made prior to instruction concern- 
ing materials, the second was made following one week^s 
instruction about the examination of materials, and the 
third was made folloxving an additional week^s examina- 
tion of materials and one day's exhibition of materials 
by publishers* representatives (the experimental mate- 
rial was not displayed). Only the third of these rat- 
ings, made after the entire period of instruction and 
following the two "trial" runs to familiarize the teach- 
ers with the process, was considered in this study. 

The teachers rated their own familiarity with 
the various materials. Data from those teachers whose 
familiarity rating for any material was greater than 
tha mid-point of the scale was used. 

Analysis of the Data 

The rank order obtained from the mean ratings 
and the mean ratings have been presented for each qual- 
ity of the materials rated in Table 15 . A combined 
rank order obtained by ranking by the sum of the pre- 
vious ranks for each material for each quality (other 
than the rater's familiarity and recommended purchase) 
has been presented in Table 16 on page 

Objectives 

The objective of this study was descriptive: To 

have determined the acceptance of the experimental 
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material by a group of Intensively trained adult basic 
education teachers using their acceptance of five tra- 
ditional programs of materials as a standard of 
comparison. 



Results 

Results of the rating are given in Tables 15 
and 16. The following abbreviations are used: Exp. ~ 

experimental material; Fol - Pollett program; Mot = Mott 
program; RD = Reader *s Digest program; SRA = Reading 
Laboratories by Science Research Associates; Stk » Steck 
program. 



Discussion 



The rank obtained by ranking by the sum of the 
previous ranks was interpreted as the best estimate of 
the true rank of the programs of materials for all 
qualities. This necessitated the interpretation of the 
results as having shown more favorable acceptance of 
the experimental material than of any of the compara- 
tive programs of materials. 

Conclusion 



The teachers participating in the Region IV Adult 
Basic Education Teacher Training Institute more favorably 
accepted the experimental material than they did the 
five traditional programs of materials rated. 



TABLE 15 
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RANK ORDER OP MATERIALS ACCORDING TO EACH OP T.^N 
QUESTIONS FOR WHICH THEY WERE RATED 



Program 




Rank 


Mean 


Number 


Question 


2: 


How familiar are you with 


this material? 


Stk 




1 


8.7 


57 


SRA 




2 


8.6 


55 


RD 




3 


8.5 


45 


Pol 




4 


8.2 


42 


Exp 




5 


7.9 


21 


Mot 




6 


7.7 


36 


Question 


3: 


Does the material contribute to the teach- 






ing of those values necessary for 


the ABE 






student's becoming a productive member of 






society? 






RD 




1 


8.8 


45 


Stk 




2 


8.7 


57 


Exp 




3 


8.5 


20 


SRA 




4 


8.4 


54 


Pol 




5.5 


7.7 


42 


Mot 




5.5 


7.7 


35 



Question 4: Does the content of the material contribute 



to the teaching of those general concepts 
necessary for the ABE student's becoming a 



RD 


productive member of society? 

1.5 8.5 


45 


Exp 


1.5 8.5 


21 


Stk 


3 8.4 


57 


SRA 


4 8.3 


55 


Pol 


5 7.8 


42 


Mot 


6 7.5 


36 


Question 5? 


Coes the content of the material 


conform 



the areas in which your experience has shown 
the ABE student to have an interest? 



Exp 

RD 

Stk 

SRA 



1 8.9 

2 8.7 

3 8.5 

4 8.3 



21 

45 

57 

54 



53 
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TABLE 15— Continued 






Program 


Rank 


Mean 


Number 


Pol 


5 


8.0 


42 


Mot 


6 


7.8 


36 


Question 6s 


Is the format of the material adult 
appearance? 


in 


RD 


1.5 


8.8 


45 


Exp 


1.5 


8.8 


20 


Stk 


3 


8.5 


57 


Pol 


4.5 


8.4 


42 


Mot 


4.5 


8.4 


14 


SRA 


6 


7.9 


54 


Question 7s 


Does the material provide 
word attack skills? 


for teaching 


SRA 


1 


8.8 


53 


Exp 


2 


8.6 


20 


RD 


3.5 


8.3 


45 


Mot 


3.5 


8.3 


36 


Stk 


5 


8.1 


56 


Pol 


6 


7.7 


41 


Question 8s 


Does the material provide 
of comprehension skills? 


for the teaching 


RD 


1 


9.1 


45 


SRA 


2 


8.9 


55 


Exp 


3 


8.8 


21 


Stk 


4 


8.3 


57 


Mot 


5 


8.1 


36 


Pol 


6 


7.8 


42 


Question 9» 


Does the material adequately take into 
account individual differences in learninff 
rates? 


Exp 


1 


8.9 


21 


SRA 


2 


8.8 


55 


RD 


3 


8.6 


44 


Stk 


4.5 


8.0 


56 


Pol 


4.5 


8.0 


41 


Mot 


6 


7.7 


36 
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Table 1»>— Continued 



Program 


Hank 


Mean 


Number 


Question 10: 


How easy do you feel It would be 
the material? 


to use 


Exp 


1 


9.4 


21 


Stk 


2.5 


8.9 


57 


RB 


2.5 


8.9 


45 


SHA 


4 


8.7 


55 


Mot 


5 


8.3 


36 


Pol 


6 


8.2 


42 


Question 11: 


If the material were modestly priced, 
would you recommend that It be bought 
for your ABE program? 


KD 


1.5 


9.0 


45 


Exp 


1.5 


9.0 


21 


Stk 


3 


8.9 


57 


SBA 


4 


8.8 


54 


Pol 


5 


8.4 


42 


Mot 


6 


8.1 


36 



TABLE 16 

COMBINED BANK PROM QUESTIONS 3 THROUGH 10 IN TABLE 15 



Program 


Hank 


Sum of Previous Ranks 


Exp 


1 


15.5 


KD 


2 


17.5 


Stk 


3 


30.0 


SHA 


4 


31.0 


Mot 


5.5 


47.5 


Pol 


5.5 


47.5 
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study Four— Expert Evaluation 



Method 



Se3.ection of Sample 

The experts were selected principally on occupa- 
tional criteria. Professors of Adult Education who have 
been active in adult basic education^ consultants in 
adult basic education who work at or above the regional 
level, and supervisors and co-ordinators of large county 
adult basic education programs were considered experts 
in the field. 

The following experts were asked to rate the ex- 
perimental material and the five "traditional" materials 

1. Dr. George F. Aker, Professor and Head of Adult 
Education, Florida State University, 

2. Dr. Weldon G. Bradtmueller, Consultant in Adult 
Basic Education for the State of Florida, Florida State 
Department of Education, 

3 * Mr. Henry G. Brady, University Resource Special- 
ist for Adult Basic Education, Florida State University. 

4, Dr, Irwin R, Jahns, Assistant Professor of Adult 
Education, Florida State University. 

5» Mr, C„ W, Lamb, Adult Basic Education Coordin^' 
ator for Duvall County, Florida, 

6. Mr. W„ W, Miley, Consultant in Adult Basic Edu- 
cation of the State of Florida, Florida State Depart- 
ment of Education, 

?• Mr . Robert E, Palmer, Consultant in Adult Basic 
Education for the State of Florida, Florida State De- 
partment of Education. 

Peerson, Supervisor of Adult Basic 
Education, Lauderdale County, Alabama. 

9., Mr. Robert D. Reid, Coordinator of Adult Basic 
Education, Pinellas County, Florida, 

10.^ Mrs. Harriet Smith, Supervisor of Adult Basic 
Education, Hollywood County, Tennessee, 






11. Dr. Curtis Ulmer, Coordinator of Adult Basic 
Education for the State of Florida, Florida State De- 
partment of Education. 

Procedure 



Fifteen experts were asked to examine the experi 
mental material and were asked to complete ”A Provision- 
al Scale for Subjective Evaluation of Adult Basic Educa- 
tion Training Materials” (copy in Appendix A). Two of 
the experts returned the forms completed. Upon comple- 
tion of the Institute rating study, a second attempt was 
made to obtain ratings from those experts who had not 
responded to the first request and from two additional 
experts. The experts were asked to evaluate the experi- 
mental material and were asked to complete a revision of 
the form first supplied. The second ratings were made 
on "A Scale for the Evaluation of Adult Basic Education 
Instructional Materials,” the same scale used by the 
Institute participants. Nine additional ratings were 
obtained • 

The two scales used were roughly equivalent, 
with the exception of a question concerning "apparent 
ease of use” having been included in the second form 
but not in the first, and the question concerning de- 
opment of reading skills on the first form having been 
divided into two specific questions concerning the 
teaching of word attack and comprehension on the 
second form. 

Analysis of the Data 

Rank orders were obtained by ranking the mean 
rating. The rank orders were obtained for each of the 
questions on the scale. These rank orders have been 
presented in Table 17, page 59. A final rank order was 
obtained by ranking the sum of the previous rank orders 
for questions three through ten (those not pertaining 
to familiarity or recommended purchase) • This rank 
has been presented in Table 18. 

Objectives 



The objective of this study was descriptive: to 

have determined the subjective evaluation of the experi- 
mental material by experts in the field using the evalu- 
ation of five traditional” materials as a standard of 
comparison. 
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Results 



The results of the rating showed the experi- 
mental material to have the highest rank by mean rating 
for each of the attributes rated except on the attri- 
bute of appearance* 

The results of the experts* ratings have been 
given in rank orders in Tables 17 and 18. pages 59 
and 61. 



Discussion 

The ratings obtained from the first form were 
equated to and combined with the ratings on the second 
form in the following manner: Questions 1, 2, 3 $ and 4 

on the first form were equated to Questions 3^ 4, 5, and 
6, respectively, on the second form; Question 5 on the 
first form was equated to and included with both Ques- 
tions 7 and 8 on the second fom; and Questions 6 and 7 
from the first form were equated to Questions 9 and 11, 
respectively, on the second form. 

All ten of the responding experts did not rate 
all of the qualities of all the materials. The ex- 
perts were asked to complete only those ratings which 
they felt qualified, as experts, to evaluate. 

The rank obtained from the sum of the previous 
ranks had been interpreted as the best estimate of the 
true" rank of materials for all questions. 

Conclusions 



It has been concluded from the results that the 
experts sampled rated the experimental material^ overall, 
a better material than any of the comparative programs 
of material. 



TABLE 17 



RANK ORDER BY MEAN RATING FOR EAOH ATTRIBUTE OP THE 
PROGRAMS OP MATERIALS AS RATED BY ELEVEN EXPERTS 



Programs in Rank Order 



Rank 



Question 3s Does the material contribute to the teach- 
ing of those values necessary for the ABE 
student *s becoming a productive member of 
society? 



Experimental 1 

Reader *s Digest 2.5 

Steck 2.5 

Mott 4 

S.R.A. Laboratories 5.5 

Pollett 5^5 



Question 4s Does the content of the material contribute 

to the teaching of those general concepts 
necessary for the ABE student's becoming a 
productive member of society? 



Experimental 
Reader's Digest 
Steck 

S.R.A. Laboratories 

Pollett 

Mott 



1 

2 

3 

4 



Question 5s Does the content of the material conform 

to the areas in which your experience has 
shown the ABE student to have an interest? 



Experimental 
Reader's Digest 
Steck 
Pollett 

S.R.A. Laboratories 
Mott 



1 

2 

3 

4 



Question 6: Is the format of the material adult in 

appearance: 



Reader's Digest 

Experimental 

Pollett 



1 

2 

3.5 
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TABLE 17” -Continued 



* 



Programs in Rank Order 



Rank 



Mott 3 

Steck 5 

S.R.A* Laboratories 6 

Question 7* Does the material provide for teaching 

word attack skills? 



Experimental 1 
S«R,A« Laboratories 2 
Reader’s Digest 4 
Pollett 4 
Mott 4 
Steck 5 



Question 8: Does the material provide for teaching 

comprehension skills? 



Experimental 

Reader ^s Digest 

S«R»A« Laboratories 

Pollett 

Mott 

Steck 




Question 9s Does the material adequately take into 

account individual differences in learning 
rates? 



Experimental 
S.R.A, Laboratories 
Steck 
Mott 

Reader’s Digest 
Pollett 



1 

2 

3.5 

3.5 

5 



Question 10: How easy do you feel it would be to use 

the material? 



Experimental 

Steck 

Reader’s Digest 

Pollett 

Mott 

S*R*A« Laboratories 



1 

2 



5 

6 
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TABLE 17--Continued 



KKr maHKm 



Programs in Bank Order 



Hank 



Question 11: If the material were modestly priced, 

would you recommend that it he bought 
for your ABE program? 

Experimental 

Reader ^s Digest 

S«H«A« Laboratories 

Pollett 

Mott 

Steck 



TABLE 18 



BANK ORDER OBTAINED FROM SUMS OF RANKS 


IN TABLE 17 


Hank Order 


Hank 


Experimental 


1 


Header’s Digest 


2 


Steck 


3 


S.H.A* Laboratories 


4 


Mott 


5 


Pollett 


6 
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PART IV 



SOME COMPARISONS BETWEEN THE STUDIES 

The Kendall rank correlation coefficient was 
used as a measure of the association between two sets 
of ranks. It has been measured for significance. 

Table 19 gives the measure of the coefficient (tau) 
and its level of significance for the ranks by means of 
the materials as rated by the teachers participating in 
the Institute and those rated by the experts. 



TABLE 19 

CORRELATIONS BETWEEN INSTITUTE PARTICIPANT RA’'3K ORDERS 
OP PROGRAMS OP MATERIALS AND RANK ORDERS OBTAINED 
PROM EXPERT MEAN RATINGS POR EACH QUALITY RATED 



Question (concerning) 


tau 


' Significance 
Level for 
Normal Dis- 
tribution 


Significance 
Interval from 
Priedman*s 
Table 3o 


3 (teaching values) 


.36 


.159 


s = 


= .235 


4 (teaching general 
concepts) 


.93 


o 

o 

• 


00 

o 

o 

• 


^.001 


5 (areas of interest) 


.87 


.007 


s * 


= .008 


6 (format) 


.66 


.032 


.068 /s ( 


CO 

CVI 

o 

« 


7 (teaching word 
attack) 


.66 


.032 


.068 i 


( .028 


8 (teaching com- 
prehension) 


.40 


.131 


.235 (s < 


( .136 


9 (accounting for 
individual dif- 
ferences) 


.57 


.055 


.136 < 


' .068 


10 (ease of use) 


.57 


.055 


.136 ( 


^ .068 


11 (recommended 
purchase 


.57 


.055 


.136 ( 


' .068 


Combined ranks 


.93 


.004 


.008 < 


' .001 
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Table 19 has shown that the only qualities of 
the materials for which the experts and the institute 
participants did not agree at a level of significance 
of a = .10 level for a normal distribution were ques- 
tions 3 and 8.^ The rank of ratings institute partici- 
pants* previously reported have shown that the experi- 
mental material was ranked third on question 3 (the 
teaching of values), and was again ranked third on 
question 8 (the teaching of comprehension). No reason 
for the lower ranks assigned by the teachers has been 
hypothesized . 

For more evidence concerning the teaching of 
comprehension skills attributes, one might examine the 
gain studies and find that the experimental material was 
provided for significant gain in these skills at the 
a « .0005 level on a one-tailed test. 

It should be noted that the experts and insti- 
tute participants were in very close agreement on the 
best approximation of the “true” rank of the programs 
of materials obtained from the sum of all qualities. 



RESULTS OP THE PROJECT 



The following are the results of the project: 

1. An experimental edition of an extensive new 
material for use in teaching reading and the general 
knowledge content appropriate to adult basic education 
was developed. 

2. ^ The project was the first attempt to use the 
scientific method properly in determining whether or not 
a new material will adequately teach reading. In the 
first study attempted, the only firm result was the find- 
ing that an experimental mortality rate of approximately 
50^ may be expected in the spring of the year in non- 
stipend, rural adult basic education classes in Northern 
Florida. 

3» The project found that both traditional adult 
basic education materials and the experimental material 
yielded post-test scores significantly greater than pre- 
test scores for both reading skills measured. 



4 . 1 . students in the experimental classes felt 

piat the experimental material was as Interesting as 
the best of the traditional materials they had used* 

5« The project found that the teachers in the ex- 
perimental classes thought the experimental material 

to be as good as the best traditional material they 
had used. 

6. The project found that adult basic education 
teachers who had received intensive instruction con- 
cerning materials and materials * evaluation thought the 
experimental material^ overall^ to be a better material 
than the best traditional material. 

7* The project found that the experts thought the 
exper^ental material, overall, to be a better material 
than the best traditional material. 

8. The project found a significant agreement be- 
tween the intensively trained teachers and the experts 
on overall rating of materials. 



DISCUSSION 



The materials compared during this project were 
materials available for use in adult basic edu- 
cation when the project was begun in November, 1966. 

Zu 2® time, other materials have become available 
that represent a much more sophisticated approach than 
some of the traditional materials used in the various 
studies of this project. Therefore, generalizations 
from this report should be limited to those materials 
available prior to November, 1966. 

The experimental material used in this project 
was of a rough or "draft" form. It was written and re- 
produced in time to be used in the experimental studies 
rP. 1967 • Therefore, generalizations from 
^5^?, report should be limited to the experimental edition 
of the experimental material. 

Because of the time limit imposed upon this pro- 
ject, another important aspect of the experimental 
material could not be tested: its contribution to the 

teaching of critical reading. Since no test of critical 
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reading ability of adult basic education students was 
available^ this aspect of materials comparisons was 
postponed until such a test has been developed • 

Because of the reduced sample sizes in the first 
gain study, no attempt to measure the gain in content 
knowledge of the areas covered by the experimental 
material was made# Because of the highly structured 
nature of ’’,he second gain study, no measurement of gain 
in content knowledge was possible# For these reasons, 
anothei^* aspect of materials* comparison was not studied 
their respective contribution to the teaching of inci- 
dental content# 



CONCLUSIONS 



Both traditional materials and the experimental 
edition of the material prepared during this project 
significantly contributed to the teaching of reading 
vocabulary and reading comprehension# 

The experimental edition of the material pre- 
pared during this project vias considered interesting 
by the students who used it, and was rated as conform- 
ing to the areas of interest of adult basic education 
students by the teachers who used it and by Intensively 
trained teachers and experts in the field who thor- 
oughly examined it# 

Both intensively trained teachers and experts in 
the field of adult basic education considered the ex- 
perimental edition of the material prepared during this 
project to be, overall, a better material for use in 
teaching reading to adult basic education students than 
the five traditional programs of materials rated# 

An incidental conclusion was that intensive 
training such as that received by the teachers parti- 
cipating in the Rebion IV Institute equipped the 
teachers who became more familiar with the materials 
than the mid -point of the scale with enough Information 
to rank adult basic education materials on overall 
quality, equally to the ranks given by experts in the 
field# 
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Implications 

Since the ratings of all materials u^ed by the 
teachers of the experimental classes and examined by 
intensively trained teachers and experts in the field of 
adult basic education were above the mid -point of the 
scale used 5 it appears that the best adult basic educa- 
tion materials have not been as worthless as some authors 
have stated. 

Since only an experimental edition of the mate- 
rial prepared during this project were examined in any 
of the studies^ it is suggested that a revised and pro- 
fessionally produced edition would better teach the 
skills involved and would be better accepted by both 
teachers and experts than the experimental edition. 

Recommendations 

It is recommended that a professional edition of 
the material prepared during this project be made avail- 
able to adult basic educators. 

It is also recommended that a group of studies 
similar to the ones reported here be carried out using 
the best adult basic education materials available. 

Such a set of studies would include tests of subject 
matter content and critical reading ability as well as 
reading vocabulary and reading comprehension. Such a 
set of studies would also compare the gains in each of 
the skills between classes using each of the materials, 
rather than combining all traditional materials in com- 
parison to the material prepared during this project. 

It is recommended that teacher training insti- 
tutes such as that used in Part III of this project 
be continued. 

It is recommended that funds be made available, 
to other projects having the purposes of preparing and 
field testing new materials, to have experimental 
editions of such new materials professionally produced 
before field testing. 
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SUMMARY 



This project had the purposes of: 

1. Preparing a new material for teaching reading 
to adult basic education students. 

2. Field testing this material. 

3. Obtaining evaluations of the material. 

The material was prepared and an experimental 
edition reproduced . 

Two studies were made of the gains in reading 
vocabulary and reading comprehension made by adult basic 
education students using the experimental edition of the 
new material and students using traditional materials « 

The experimental mortality rate of the first 
gain study was so great that generalizations from the 
data are not recommended. 

The second gain study showed significant dif- 
ference between post-test versus pre-test means for both 
skills for both experimental and control groups. There 
was some evidence that the experimental edition of the 
new material was teaching the two skills better than the 
traditional materials, although the difference was not 
always statistically significant. 

A study of student acceptance of the new materi- 
al was made. The students rated the material as inter- 
esting; then, in comparison to traditional materials 
they had used, the students rated the new material as 
more interesting than some of the traditional materials 
and just as interesting as the best of the traditional 
materials . 

Two studies of teacher acceptance of the new 
material were made. In the first study, the adult basic 
education teachers who used the new material in the first 
gain study rated it according to several attributes or 
qualities possessed by adult basic education materials. 
They also rated the traditional materials they had used. 
No traditional material was better accepted than the ex- 
perimental edition of the new material* 






The second study of teacher acceptance was made 
with the rating population composed of the teachers 
participating in the Region IV Adult Basic Education 
Teacher Training Institute who had received intensive 
instruction about adult basic education materials. They 
rated the experimental edition of the new material and 
five of the best traditional materials available at 
that time. Overall, they rated the experimental edition 
of the new material as a better material than any of the 
traditional materials rated. The implication being that 
a professional edition of the new material would have 
been rated as even better than existing materials. 

An exjpert evaluation study of the new material 
was made. Eleven experts in the field of adult basic 
education evaluated the experimental edition of the new 
material and five popular traditional materials avail- 
able at that time. The experts* evaluations showed 
that the experimental edition of the new material, over- 
all, was a better material than any of the five popular 
traditional materials rated. The implications being 
that a professionally produced edition of the new materi- 
al would have been rated as even better than existing 
materials . 

Ah incidental fi*idlng was that the teachers par- 
ticipating in the Region IV Institute who became familiar 
with the materials considered in this study made ratings 
whose combined rank order did not differ from the com- 
bined rank order of the materials as rated by the eleven 
experts. This agreement was significant above the 
a = .005 level. 

It would appear, from this study, that reading 
materials dealing with the content areas of adult 
basic education are well accepted by both students and 
teachers and that the kit approach with its stress on 
individualized learning is an effective method for 
teaching adult basic education students. 
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APPENDIX A 

THE RATING FORMS USED 



1. A Provisional Scale for Pupil Evaluation of 
Adult Basic Education Training Materials. 

2m A Provisional Scale for Teacher Evaluation of 
Adult Basic Education Training Materials. 

3* A Provisional Scale for Subjective Evaluation 
of Adult Basic Education Training Materials. 

4. A Scale for Evaluation of Adult Basic Educa* 
tion Instructional Materials. 



A PROVISIOHAL SCALE FOR PUPIL EVALUATION OF 
ADULT BASIC EDUCATION TRAINING MATERIALS 

Examiner's Copy 
PART I 



Directions : Pass out answer forms. Then read: ”You 

have read some of the articles In the FACT KIT. We 
would like to know how well you liked them. We want 
you to grade them.” 

"Look at the top part of the paper. There you 
will find the words good , all right , and had . If you 
thought the articles were very interesting draw a circle 
around good. If you thought they were not too inter- 
esting but not bad then draw a circle around all right . 
If you thought the articles were not interesting at all 
draw a circle around bad.” 



»« 
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A PROVISIONAL SCALE FOR PUPIL EVALUATION OP 
ADULT BASIC EDUCATION TRAINING MATERIALS 

Examiner *s Copy 



PART II 



Directions * (If not following Part I) • Pass out answer 
forms. 



(Read orally: ) You have all used some materials 
besides the PACT KIT In this class. We would like to 
know how the kit compares with those other materials. 

On the bottom half of the page you will see the letters 
» » ^ and E. Under each of these Is a 1^ a 2. 
and a 3. Has everyone found them? 



Very good^ now this Is what we are going to do: 

I am going to hold up a material, like this. 
Some of you may have used it, some of you may not. If 
you haven* t used it, you don*t have to do anything 
this time. 



. . . material, I want to know 

how the PACT KIT compares with it. If the kit is more 
interesting, circle the 1 under the (^ B, C, etc.). 

If the kit has about the same interest as this material, 
circle the 2 under the (A, B, C etc.). If the kit is 
less interesting, circle the 3“ynder the (A, B, & C«s). 



Tx. Now let*s do the same thing with this material. 
If you haven't used it, you don't have to do anything 
this time. 



(Repeat instructions.) 
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A PROVISIONAL SCALE FOR TEACHER EVALUATION OP 
ADULT BASIC EDUCATION TRAINING MATERIALS 



Directions s Put a check in the space which you feel 

represents the quality of the material for the attri- 
bute being rated. 10 is a perfect material; 1 is a 

completely inadequate material. 

Material : 

Evaluator; 

1* How useful do you feel the material is as a teach- 
ing tool ? 

“ “ “T" “ T" ~ “T" “ 

2. How ^asy do you feel it is use the material? 

3« Would you like to use the material as a core of 
your reading program? 

4. How much interest did most of your students show 
in the material? 

5« Do you think the material is appropriate for use in 
ABE classes? 

6» If the neterlel would you recon~ 

mend that it be bought for your adult program? 

“r-^T"r~r'irT""5”ir-io 



A PROVISIONAL SCALE FOR SUBJECTIVIS EVALUATION 
OP ADULT BASIC EDUCATION TRAINING MATERIALS 

Directions ; Put a check in the space wMch you feel 
represents the quality of the material for the attri- 
bute being rated. 10 is a perfect material; 1 is a 
completely inadequate material. 

Material ; 

Evaluator ; 



1. Do the materials significantly contribute to teaching 
those concepts and values necessary for the ABE 
student *s becoming a productive social being? 

2m Are contents of the material appropriate to teaching 
the general knowledge necessary for the ABE student *s 
becoming a productive social being? 

— ~ ~J~ T" ~5~ “S“ “7“ " 5 ” ~9~ “lo 

3« Does the content of the material conform to the 

areas in which your experience with the ABE student 
has shown him to have interest? 

"T" T~ ~3~ T" “5“ “ 5 “ ~7~ T~ T" "10 

4. Is the format of the material appropriate for use 
with adults? 

Does the material provide for adequate development 
of reading skills ? 

IT ~2 J" "5 5“ “5 7 "T'““I 5 

6. Does the material adequately take into account 
individual differences in learning rates and 
interest? 

7* How do you rate the material for all the above 
attributes combined ? 

T" T~ T' ~Tr T" T~ T" TT “9" "10 
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A SCALE FOR EVALUATION OP ADULT BASIC EDUCATION 

INSTRUCTIONAL MATERIALS 



DIRECTIONS 

The next three pages are identical. They con- 
tain questions about ABE materials. Please help us to 
evaluate these materials by rating them honestly. Please 
give your own opinions about the material, and try not to 
be influenced by what others may think of the materials. 

You have three pages, and below you will find 
that you are asked to rate six different materials. This 
means you will have to rate two materials on each page. 
You will find this easiest if you use the symbols below, 
and this will also help us keep the correct ratings for 
the material you intended. 



Symbols Material Page 

S . . • • S.R*A. Kits . first 

M . , , , Mott Program first 

^ • Pollett Program . . . . . second 

T . . , , Steck Program second 

R . . . . Reader's Digest Program. • third 

A . . , , Pact Kits third 



Materials MAY be rated on the same space. If you 
feel the two materials you are rating are equal, you may 
put both symbols on the same space. Por example M This 
would say that you feel both materials should S _ 
be rated on this same space. 



Please rate all of the materials with which you 
are familiar, whether you have used them all or noi.. If 
you find a material with which you are not at all fam- 
iliar, you may not want to rate it. If this is the case, 
please rate at least your familiarity with the, material 
(question 2) so that we will know that you did* not iust 
leave it out. 



Please put your name on each of the pages. Peel 
free to use the back of the pages for any additional 
comments you wish to make. 
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A SCALE FOR EVALUATION OP ADULT BASIC EDUCATION 

INSTRUCTIONAL MATERIALS 

Evaluator: Material(s) 

My position in ABE is: Administrator^ Supervisor^ Full- 

time teacher. Part-time teacher, othe r 

Directions: Please put the ssrmhol for the material you 

are rating in the space you feel represents the quality 
of the material for the attribute mentioned in the ques- 
tion* A rating of 10 would be for a perfect material, 
and a rating of one would be for a completely inade- 
quate material. 

1. Have you used this material? Yes No 



2. How familiar are you i^ith this material? 

3. Uo the materials contribute to the teaching of 
those values necessary for the ABE student*s be- 
coming a productive member of society? 

123 ? 5?^75910 

4. Does the content of the material contribute to the 
teaching of those general concepts necessary for the 
ABE student *s becoming a productive member of 
society? 

T232T55'75'910 

5» Does the content of the material conform to the 
areas in which your experience has shown the ABE 
student to have an interest ? 

1235557^910 

6. Is the format of the material adult in appearance? 

12355575910 

7. Does the material provide for the teaching of 
word attack skills? 






!BKW ja!i » jiLg j!ag Mj a « <» :!C .»=g;gaBg3iMg^^ 



8. Does the material provide for the teaching of 
comprehension skills? 

12355S7H910 

9« Does the material adequately take into account 
individual differences in learning rates? 

10. How easy do you feel it would he to use the material? 

T53¥5^7^910 

11 • If the material were modestly priced^ would you recom 
mend that it be bought for your ABE program? 

X23f5^7l910 

You may put any additional comments on the back of this 

page. 
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A SCALE FOR EVALUATION OF ADULT BASIC EDUCATION 

INSTRUCTIONAL MATERIALS 

Evaluator: Material (s): 

My position In ABE Is: Administrator^ Supervisor j Full- 

time teacher. Part-time teacher, othe r 

Directions : Please put the symbol for the material you 

are rating in the space you feel represents the quality 
of the material for the attribute mentioned in the ques- 
tion. A rating of 10 would be for a perfect material, 
6uid a rating of one would be for a completely inade- 
quate material. 

1. Have you used this material? Yes N o 

2. How familiar are you with this material? 

T 2 3 f 5 S'TH 9 I 0 

3. Do the materials contribute to the teaching of 
those values necessary for the ABE student *s be- 
coming a productive member of society? 

T23f5?l759lo 

4. Does the content of the material contribute to the 
teaching of those general concents necessary for 
the ABE student’s becoming a productive member of 
society? 

3* Does the content of the material conform to the 
areas in which your experience has shown the ABE 
student to have an interest ? 

6 , Is the format of the material adult in appearance? 

7. Does the material provide for the teaching of 
word attac)^ skills? 

155? 5 57^9 l5 
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8. Does the material provide for the teaching of 
c^omprehension skills? 

T 2 3 7 5 7 F 9 1^ 



9. Does the material adequately take into account 
individual differences in learning rates? 

123?557ff910 



10, How easy do you feel it would be to use the 
material? 

12 355^75910 

If the material were modestly priced^ would you 
recommend that it be bought for your ABE program? 

12355575910 

You may put any additional comments on the back of this 
page. 




A SCAIiE FOR E\TALUATION OF ADULT BASIC EDUCATION 

INSTRUCTIONAL MATERIALS 

Evaluator; Materialfs): 

position in ABE is; Administrator, Supervisor, Full- 
time teacher. Part-time teacher, othe r 

Birections ; Please put the symbol for the material you 
are rating in the space you feel represents the quality 
of the material for the attribute mentioned in the ques- 
tion* A rating of 10 would be for a perfect material, 
and a rating of one would be for a completely inade- 
quate material* 

1* Have you used this material? Yes No 



2* Hew familiar are you with this material? 

12 3 5 5 5" 7 5 9 10 

3« Do the materials contribute to the teaching of 
those values necessary for the ABE student be- 
coming a productive member of society? 

1235^5575910 

4* Does the content of the material contribute to the 
teaching of those general concepts necessary for 
the ABE student^s becoming a productive member of 
society? 

1235^5 5 7 5 9 10 

Does the content of the material conform to the 
areas in which your experience has shown the ABE 
student to have an interest ? 

123'ff55755lO 

6* Is the format of the material adult in appearance? 

1235^5575910 

7 • Does the material provide for the teaching of 
word attack skills? 






g 3 0tl iggj l! mE3 B a »l 



8. Coes the loaterial provide for the teaching of 
comprehension skills? 

I 2 3 5 55^ 7^5 IS 

9< Coes the material ade(|uately take into account 
Individual differences in learning rates? 

10. How easy do you feel it would he to use the 
material? 



I2355S755 10 

11. If the material were modestly priced, would you 
recommend that it be bou^dit for your ABE program? 

You may put any additional conments on the back of thla 
page. 
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